Jul 07 02:12:38.955979 ip-10-0-137-16 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 02:12:38.955995 ip-10-0-137-16 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 02:12:38.956006 ip-10-0-137-16 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 02:12:38.956461 ip-10-0-137-16 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 02:12:49.062910 ip-10-0-137-16 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 02:12:49.062929 ip-10-0-137-16 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c90d46efd77341be9388f68090582f35 --
Jul 07 02:14:46.593285 ip-10-0-137-16 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 02:14:47.026510 ip-10-0-137-16 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:47.026510 ip-10-0-137-16 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 02:14:47.026510 ip-10-0-137-16 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:47.026510 ip-10-0-137-16 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 02:14:47.026510 ip-10-0-137-16 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:47.027475 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.027383    2545 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038116    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038138    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038142    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038147    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038153    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.038145 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038156    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038159    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038162    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038165    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038168    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038171    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038174    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038176    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038179    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038182    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038184    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038187    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038190    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038194    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038197    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038200    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038202    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038206    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038208    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.038387 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038211    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038213    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038216    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038218    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038222    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038225    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038228    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038230    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038233    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038236    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038238    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038241    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038243    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038246    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038249    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038252    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038256    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038258    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038261    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038263    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.038843 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038266    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038268    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038271    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038273    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038275    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038278    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038280    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038283    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038285    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038288    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038291    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038293    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038296    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038298    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038301    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038303    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038306    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038308    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038311    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038314    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.039391 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038317    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038319    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038321    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038324    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038326    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038329    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038332    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038335    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038338    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038341    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038343    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038346    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038348    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038350    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038353    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038355    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038358    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038360    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038362    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038365    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.039870 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038368    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038370    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038372    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038374    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038377    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038380    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038382    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038385    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038388    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038391    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038394    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038396    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038399    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038401    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.038404    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039159    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039167    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039169    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039176    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.040366 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039180    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039183    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039186    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039189    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039192    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039194    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039197    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039199    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039202    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039205    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039207    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039210    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039212    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039215    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039217    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039220    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039222    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039226    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039229    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039232    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.040833 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039234    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039237    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039240    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039243    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039246    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039249    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039252    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039254    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039257    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039259    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039262    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039264    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039267    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039270    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039272    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039275    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039277    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039280    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039282    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039285    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.041338 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039287    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039290    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039292    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039295    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039297    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039306    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039310    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039313    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039317    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039320    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039323    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039326    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039328    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039331    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039333    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039336    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039339    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039341    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039344    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.041822 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039346    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039349    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039351    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039354    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039357    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039359    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039362    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039364    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039367    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039369    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039372    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039374    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039376    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039379    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039381    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039384    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039386    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039389    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039393    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039396    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.042305 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039399    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039403    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039406    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039408    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039411    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039414    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039417    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039419    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039422    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039424    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039427    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039430    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039433    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039436    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039438    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039441    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039908    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039914    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039937    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.042794 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039942    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039946    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039948    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039951    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039953    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039956    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039958    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039961    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039964    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039966    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039969    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039971    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039974    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039978    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039981    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039983    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039986    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039989    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039991    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039995    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.043310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.039997    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040000    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040002    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040005    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040007    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040010    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040012    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040015    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040017    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040020    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040022    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040025    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040027    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040030    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040033    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040035    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040038    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040043    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040045    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040048    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.043792 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040050    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040054    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040058    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040061    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040063    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040066    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040069    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040071    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040074    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040077    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040079    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040082    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040084    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040087    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040089    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040092    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040094    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040097    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040099    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.044291 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040101    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040104    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040106    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040109    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040111    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040114    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040117    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040119    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040121    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040124    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040128    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040130    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040133    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040135    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040137    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040140    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040142    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040145    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040147    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040149    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.044788 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040152    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040155    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040157    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040159    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040162    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040164    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040170    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040172    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040175    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040177    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040180    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040184    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040187    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040190    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040193    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040195    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040198    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040290    2545 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040299    2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040310    2545 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 02:14:47.045293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040317    2545 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040321    2545 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040326    2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040330    2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040335    2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040337    2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040340    2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040344    2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040347    2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040350    2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040353    2545 flags.go:64] FLAG: --cgroup-root=""
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040356    2545 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040358    2545 flags.go:64] FLAG: --client-ca-file=""
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040362    2545 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040366    2545 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040371    2545 flags.go:64] FLAG: --cluster-domain=""
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040374    2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040377    2545 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040381    2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040385    2545 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040388    2545 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040391    2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040394    2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 02:14:47.045770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040397    2545 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040400    2545 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040403    2545 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040406    2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040409    2545 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040412    2545 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040419    2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040422    2545 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040424    2545 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040427    2545 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040430    2545 flags.go:64] FLAG: --enable-server="true"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040434    2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040438    2545 flags.go:64] FLAG: --event-burst="100"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040441    2545 flags.go:64] FLAG: --event-qps="50"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040444    2545 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040447    2545 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040450    2545 flags.go:64] FLAG: --eviction-hard=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040454    2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040456    2545 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040459    2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040462    2545 flags.go:64] FLAG: --eviction-soft=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040465    2545 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040468    2545 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040478    2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040481    2545 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 02:14:47.046370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040484    2545 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040487    2545 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040490    2545 flags.go:64] FLAG: --feature-gates=""
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040499    2545 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040501    2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040504    2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040507    2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040510    2545 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040513    2545 flags.go:64] FLAG: --help="false"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040516    2545 flags.go:64] FLAG: --hostname-override="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040519    2545 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040522    2545 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040524    2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040528    2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040531    2545 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040534    2545 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040537    2545 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040540    2545 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040543    2545 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040546    2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040550    2545 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040553    2545 flags.go:64] FLAG: --kube-reserved=""
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040556    2545 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040558    2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 02:14:47.046987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040561    2545 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040564    2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040567    2545 flags.go:64] FLAG: --lock-file=""
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040569    2545 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040572    2545 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040575    2545 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040580    2545 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040584    2545 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040586    2545 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040589    2545 flags.go:64] FLAG: --logging-format="text"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040593    2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040596    2545 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040599    2545 flags.go:64] FLAG: --manifest-url=""
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040602    2545 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040606    2545 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040609    2545 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040614    2545 flags.go:64] FLAG: --max-pods="110"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040616    2545 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040619    2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040622    2545 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040625    2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040628    2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040631    2545 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040633    2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040641    2545 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 02:14:47.047593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040644    2545 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040647    2545 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040650    2545 flags.go:64] FLAG: --pod-cidr=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040653    2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040658    2545 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040661    2545 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040663    2545 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040666    2545 flags.go:64] FLAG: --port="10250"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040669    2545 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040672    2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-097ad75be3ad8ce75"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040675    2545 flags.go:64] FLAG: --qos-reserved=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040678    2545 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040680    2545 flags.go:64] FLAG: --register-node="true"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040683    2545 flags.go:64] FLAG: --register-with-taints=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040686    2545 flags.go:64] FLAG: --registry-burst="10"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040690    2545 flags.go:64] FLAG: --registry-qps="5"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040693    2545 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040696    2545 flags.go:64] FLAG: --reserved-memory=""
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040700    2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040703    2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040706    2545 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040709    2545 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040712    2545 flags.go:64] FLAG: --runonce="false"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040714    2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040717    2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 02:14:47.048204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040720    2545 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040723    2545 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040725    2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040728    2545 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040731    2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040734    2545 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040737    2545 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040740    2545 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040742    2545 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040745    2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040748    2545 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040751    2545 flags.go:64] FLAG: --system-cgroups=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040753    2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040759    2545 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040761    2545 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040764    2545 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040768    2545 flags.go:64] FLAG: --tls-min-version=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040770    2545 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040773    2545 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040776    2545 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040779    2545 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040782    2545 flags.go:64] FLAG: --v="2"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040786    2545 flags.go:64] FLAG: --version="false"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040790    2545 flags.go:64] FLAG: --vmodule=""
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040794    2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 02:14:47.048930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.040799    2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040942    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040947    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040951    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040954    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040957    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040960    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040962    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040966    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040969    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040972    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040975    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040977    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040980    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040985    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040989    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040992    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040995    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.040998    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.049550 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041001    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041003    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041006    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041008    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041011    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041013    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041017    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041021    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041024    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041027    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041030    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041033    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041036    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041040    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041043    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041046    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041049    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041051    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041054    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.050061 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041056    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041059    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041061    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041064    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041066    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041068    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041071    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041074    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041078    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041080    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041083    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041086    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041088    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041091    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041093    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041095    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041098    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041100    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041102    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041105    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.050527 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041107    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041110    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041112    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041115    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041118    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041120    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041125    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041127    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041130    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041132    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041135    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041137    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041139    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041142    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041145    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041147    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041150    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041152    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041154    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041157    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.051031 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041161    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041163    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041166    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041168    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041171    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041173    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041176    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041178    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041181    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041183    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041186    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041188    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041190    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041193    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041195    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041198    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041200    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041203    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041207    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041210    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.051521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041212    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.041215    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.041937    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.048947    2545 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.048966    2545 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.050182    2545 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.050189    2545 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050250    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050255    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050258    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050262    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050264    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050267    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050270    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050273    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.052025 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050275    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050278    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050281    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050284    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050286    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050289    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050292    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050294    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050297    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050299    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050302    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050304    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050307    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050309    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050312    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050314    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050317    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050320    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050322    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050325    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.052394 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050328    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050331    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050334    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050336    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050339    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050342    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050344    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050346    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050349    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050352    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050354    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050357    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050360    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050362    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050365    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050368    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050370    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050372    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050375    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050377    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.052859 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050380    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050382    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050385    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050387    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050390    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050393    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050396    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050398    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050402    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050406    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050409    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050412    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050415    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050420    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050424    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050427    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050430    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050434    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.053357 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050438    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050441    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050444    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050447    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050450    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050453    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050455    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050458    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050461    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050463    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050466    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050469    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050472    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050474    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050477    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050479    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050481    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050484    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050487    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.053789 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050489    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050492    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050494    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050497    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050499    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050502    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050505    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050508    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050511    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050513    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050516    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050518    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050521    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050523    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.050528    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:47.054263 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050647    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050651    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050654    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050657    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050660    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050662    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050665    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050668    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050671    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050673    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050676    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050678    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050681    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050684    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050687    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050689    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050693    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050695    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050698    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:47.054646 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050700    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050704    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050707    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050710    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050714    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050717    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050719    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050722    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050725    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050728    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050730    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050733    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050736    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050739    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050742    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050744    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050748    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050750    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050753    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:47.055133 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050755    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050757    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050760    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050763    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050765    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050768    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050770    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050772    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050775    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050777    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050780    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050782    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050785    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050787    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050790    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050792    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050795    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050797    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050800    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050803    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:47.055584 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050805    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050807    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050810    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050812    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050815    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050817    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050820    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050822    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050824    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050827    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050829    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050832    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050834    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050837    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050839    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050842    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050844    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050847    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050851    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050854    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:47.056076 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050856    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050859    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050862    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050869    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050872    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050875    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050878    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050881    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050884    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050886    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050889    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050891    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050894    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050896    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050899    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050901    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050904    2545 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050906    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050909    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050911    2545 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:47.056557 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:47.050914    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.050936    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.051089    2545 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.053218    2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.054685    2545 server.go:1019] "Starting client certificate rotation"
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.054792    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:14:47.057048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.054835    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:14:47.057230 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.057147    2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:14:47.060537 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.060521    2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:14:47.070506 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.070476    2545 log.go:25] "Validated CRI v1 runtime API"
Jul 07 02:14:47.072579 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.072562    2545 log.go:25] "Validated CRI v1 image API"
Jul 07 02:14:47.073488 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.073471    2545 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 02:14:47.078782 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.078760    2545 fs.go:135] Filesystem UUIDs: map[68579731-9b12-4b63-8718-e25c971eac78:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 95b71023-b19f-4167-a244-62d4f5c3ebbe:/dev/nvme0n1p4]
Jul 07 02:14:47.078869 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.078782    2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 02:14:47.085256 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.085115    2545 manager.go:216] Machine: {Timestamp:2026-07-07 02:14:47.083531759 +0000 UTC m=+0.368387011 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100857 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d6bb016693a3814f648c3ef73e21 SystemUUID:ec20d6bb-0166-93a3-814f-648c3ef73e21 BootID:c90d46ef-d773-41be-9388-f68090582f35 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:00:27:5f:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:00:27:5f:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:56:f4:25:04:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 02:14:47.085256 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.085249    2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 02:14:47.085380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.085353    2545 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 02:14:47.088503 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.088483    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:14:47.088994 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.088961    2545 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 02:14:47.089176 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.089003    2545 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-16.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 02:14:47.089934 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.089906    2545 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 02:14:47.089988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.089941    2545 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 02:14:47.089988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.089952    2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:14:47.090606 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.090593    2545 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:14:47.092033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.092021    2545 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 02:14:47.094953 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.094938    2545 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:14:47.095114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095102    2545 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 02:14:47.095177 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095145    2545 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 02:14:47.095177 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095168    2545 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 02:14:47.095272 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095198    2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 02:14:47.095272 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095216    2545 kubelet.go:398] "Adding apiserver pod source"
Jul 07 02:14:47.095272 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095243    2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 02:14:47.095640 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095625    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:14:47.095704 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.095650    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:14:47.097913 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.097895    2545 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 02:14:47.099789 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.099775    2545 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 02:14:47.099843 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.099806    2545 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 02:14:47.100854 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100842    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 02:14:47.100889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100860    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 02:14:47.100889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100866    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 02:14:47.100889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100871    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 02:14:47.100889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100880    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 02:14:47.100889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100885    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100892    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100898    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100904    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100910    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100940    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 02:14:47.101035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.100946    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 02:14:47.101676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.101666    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 02:14:47.101710 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.101676    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 02:14:47.105043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.105029    2545 server.go:1268] "Started kubelet"
Jul 07 02:14:47.105334 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.105256    2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 02:14:47.105410 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.105370    2545 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 02:14:47.105462 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.105438    2545 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 02:14:47.105782 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.105760    2545 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-16.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 02:14:47.105866 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.105789    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 02:14:47.105866 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.105790    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 02:14:47.106027 ip-10-0-137-16 systemd[1]: Started Kubernetes Kubelet.
Jul 07 02:14:47.107230 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.107209    2545 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 02:14:47.108654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.108630    2545 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 02:14:47.111959 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.111937    2545 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 02:14:47.113997 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.113981    2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 02:14:47.114088 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114000    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 02:14:47.114148 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.114125    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.114414 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.113347    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-16.ec2.internal.18bfe032ffb45d2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-16.ec2.internal,UID:ip-10-0-137-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-16.ec2.internal,},FirstTimestamp:2026-07-07 02:14:47.105002799 +0000 UTC m=+0.389858051,LastTimestamp:2026-07-07 02:14:47.105002799 +0000 UTC m=+0.389858051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-16.ec2.internal,}"
Jul 07 02:14:47.114580 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114564    2545 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 02:14:47.114580 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114573    2545 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 02:14:47.114696 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114583    2545 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 02:14:47.114696 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114673    2545 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 02:14:47.114696 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.114682    2545 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 02:14:47.115512 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115496    2545 factory.go:55] Registering systemd factory
Jul 07 02:14:47.115567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115552    2545 factory.go:223] Registration of the systemd container factory successfully
Jul 07 02:14:47.115828 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115810    2545 factory.go:153] Registering CRI-O factory
Jul 07 02:14:47.115828 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115829    2545 factory.go:223] Registration of the crio container factory successfully
Jul 07 02:14:47.115976 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115875    2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 02:14:47.115976 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115899    2545 factory.go:103] Registering Raw factory
Jul 07 02:14:47.115976 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.115912    2545 manager.go:1196] Started watching for new ooms in manager
Jul 07 02:14:47.116886 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.116868    2545 manager.go:349] Starting recovery of all containers
Jul 07 02:14:47.122515 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.122390    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z7qld"
Jul 07 02:14:47.123937 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.123888    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 02:14:47.124044 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.123944    2545 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 02:14:47.127480 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.127372    2545 manager.go:354] Recovery completed
Jul 07 02:14:47.131587 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.131569    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.132835 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.132820    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z7qld"
Jul 07 02:14:47.135525 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.135506    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.135631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.135545    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.135631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.135562    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.136213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.136197    2545 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 02:14:47.136213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.136212    2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 02:14:47.136345 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.136226    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.136345 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.136231    2545 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:14:47.137149 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.137132    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.137217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.137161    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.137217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.137175    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.138643 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.138573    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-16.ec2.internal.18bfe03301861ff1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-16.ec2.internal,UID:ip-10-0-137-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-16.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-16.ec2.internal,},FirstTimestamp:2026-07-07 02:14:47.135526897 +0000 UTC m=+0.420382156,LastTimestamp:2026-07-07 02:14:47.135526897 +0000 UTC m=+0.420382156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-16.ec2.internal,}"
Jul 07 02:14:47.140710 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.140698    2545 policy_none.go:49] "None policy: Start"
Jul 07 02:14:47.140759 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.140715    2545 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 02:14:47.140759 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.140727    2545 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 02:14:47.142192 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.142180    2545 policy_none.go:47] "Start"
Jul 07 02:14:47.214708 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.214679    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.242572    2545 manager.go:337] "Starting Device Plugin manager"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.242634    2545 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.242648    2545 server.go:87] "Starting device plugin registration server"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.242968    2545 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.242982    2545 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.243246    2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.243338    2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.243347    2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.251138    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.252572    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.252608    2545 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.252634    2545 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.252667    2545 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.255215    2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.255289    2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.257038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.255410    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:47.337659 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.337631    2545 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-16.ec2.internal\" not found" node="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.343759 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.343735    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.344935 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.344907    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.345010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.344951    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.345010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.344962    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.345010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.344987    2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.353044 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.353021    2545 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"]
Jul 07 02:14:47.353097 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.353092    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.354726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.354707    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.354793 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.354741    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.354793 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.354754    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.355857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.355843    2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.355903 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.355865    2545 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-16.ec2.internal\": node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.356225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356213    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.356325 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356314    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.356380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356346    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.356972 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356958    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.357039 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356973    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.357039 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356989    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.357039 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.357000    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.357126 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.356992    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.357126 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.357079    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.358245 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.358224    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.358331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.358249    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:47.359068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.359048    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:47.359171 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.359083    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:47.359171 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.359094    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:47.373145 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.373119    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.373593 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.373576    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-16.ec2.internal\" not found" node="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.378129 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.378113    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-16.ec2.internal\" not found" node="ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.417618 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.417591    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc099c7007974686ef1fc33ec7465c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-16.ec2.internal\" (UID: \"b5fc099c7007974686ef1fc33ec7465c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.417727 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.417622    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.417727 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.417646    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.474161 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.474134    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.517795 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517762    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.517878 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517797    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.517878 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517815    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc099c7007974686ef1fc33ec7465c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-16.ec2.internal\" (UID: \"b5fc099c7007974686ef1fc33ec7465c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.517878 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517859    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.517878 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517871    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/126c0b745ca1a36f8c0674a19658885c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal\" (UID: \"126c0b745ca1a36f8c0674a19658885c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.518041 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.517943    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5fc099c7007974686ef1fc33ec7465c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-16.ec2.internal\" (UID: \"b5fc099c7007974686ef1fc33ec7465c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.574728 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.574692    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.675417 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.675336    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.677498 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.677480    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.681745 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:47.681306    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:47.776336 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.776291    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.876897 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.876869    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:47.977463 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:47.977377    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:48.053682 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.053643    2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 02:14:48.054349 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.053828    2545 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 02:14:48.078873 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:48.078836    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:48.144758 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.144702    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 02:09:47 +0000 UTC" deadline="2028-04-11 23:17:33.750432894 +0000 UTC"
Jul 07 02:14:48.144758 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.144746    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15477h2m45.605690451s"
Jul 07 02:14:48.180073 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:48.180043    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-16.ec2.internal\" not found"
Jul 07 02:14:48.254476 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.254403    2545 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:48.290652 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:48.290612    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126c0b745ca1a36f8c0674a19658885c.slice/crio-73a6d8ae8f94eb323a2b776d58630a87ee99318f4ba489873177e12b33f08944 WatchSource:0}: Error finding container 73a6d8ae8f94eb323a2b776d58630a87ee99318f4ba489873177e12b33f08944: Status 404 returned error can't find the container with id 73a6d8ae8f94eb323a2b776d58630a87ee99318f4ba489873177e12b33f08944
Jul 07 02:14:48.291553 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:48.291528    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fc099c7007974686ef1fc33ec7465c.slice/crio-15d942d054602b37de18f866206f853f1557238867be8dd24f9873098d32387c WatchSource:0}: Error finding container 15d942d054602b37de18f866206f853f1557238867be8dd24f9873098d32387c: Status 404 returned error can't find the container with id 15d942d054602b37de18f866206f853f1557238867be8dd24f9873098d32387c
Jul 07 02:14:48.292565 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.292547    2545 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:48.298260 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.298244    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:14:48.314619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.314589    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:48.327673 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.327635    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:14:48.328857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.328841    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal"
Jul 07 02:14:48.337322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.337302    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:14:48.346014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:48.345992    2545 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:49.082069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.082034    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:49.096820 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.096787    2545 apiserver.go:52] "Watching apiserver"
Jul 07 02:14:49.103807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.103778    2545 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 02:14:49.105363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.105209    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-24xlz","openshift-network-operator/iptables-alerter-658g9","openshift-ovn-kubernetes/ovnkube-node-4sh2j","kube-system/global-pull-secret-syncer-5g2xh","kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hmklh","openshift-dns/node-resolver-gxxz7","openshift-image-registry/node-ca-cdzq5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal","openshift-multus/multus-hv4sq","openshift-multus/network-metrics-daemon-7gmps","kube-system/konnectivity-agent-r64rk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf","openshift-multus/multus-additional-cni-plugins-smm6b"]
Jul 07 02:14:49.113408 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.113384    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.115453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.115125    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.115453 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.115233    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:14:49.115643 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.115538    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 02:14:49.116102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.116078    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tbvrc\""
Jul 07 02:14:49.116212 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.116099    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.116360 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.116344    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.119832 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.119807    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.120280 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.120260    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.120377 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.120337    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:49.121507 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.121487    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.122319 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.121494    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.122319 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.122047    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 02:14:49.122319 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.121685    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.122907    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fzwqs\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.122964    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.123125    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.123228    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.123302    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.123459    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.123929    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.124424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.124352    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 02:14:49.124884 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.124639    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.125483    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.125638    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.125714    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.125817    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smf7v\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126064    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hx45g\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126078    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126115    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126359    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126373    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126470    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c466h\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126646    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-netns\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126685    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-log-socket\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126717    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-config\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126751    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b72273f-bfd0-4091-86fe-aa32631c8311-tmp-dir\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126778    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqj4\" (UniqueName: \"kubernetes.io/projected/2b72273f-bfd0-4091-86fe-aa32631c8311-kube-api-access-2wqj4\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126806    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-slash\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126838    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126916    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.127023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.126838    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127113    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127221    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-ovn\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127259    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127287    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-script-lib\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127313    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jds2t\" (UniqueName: \"kubernetes.io/projected/0f23088c-3193-4be2-af40-c166d264fffc-kube-api-access-jds2t\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127343    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xgdcl\""
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127369    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b72273f-bfd0-4091-86fe-aa32631c8311-hosts-file\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127395    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127392    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127395    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-systemd-units\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127626    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-var-lib-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127655    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-bin\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127682    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127711    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-env-overrides\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127736    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f23088c-3193-4be2-af40-c166d264fffc-ovn-node-metrics-cert\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127763    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127820    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wbxm\" (UniqueName: \"kubernetes.io/projected/68d91463-8bf4-43e9-9489-b387548b79c9-kube-api-access-8wbxm\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.128295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127855    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-kubelet\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.129302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127880    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-systemd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.129302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127928    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-etc-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.129302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127973    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-node-log\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.129302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.127997    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-netd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.129302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.129264    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 02:14:49.129567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.129474    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 02:14:49.129695 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.129677    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:14:49.129912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.129891    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rs549\""
Jul 07 02:14:49.130273 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.130062    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.131152 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.130842    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:49.131152 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.130918    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:49.132631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.132285    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 02:14:49.132631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.132298    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fjzxh\""
Jul 07 02:14:49.132631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.132361    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.136636 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.135806    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l6hwm\""
Jul 07 02:14:49.136636 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.136092    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 02:14:49.137100 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.137081    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 02:14:49.143281 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.142430    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:14:49.187738 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.187705    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7f9wx"
Jul 07 02:14:49.208160 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.208136    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7f9wx"
Jul 07 02:14:49.216505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.216473    2545 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 02:14:49.228916 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.228884    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-log-socket\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229110 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.228978    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-log-socket\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229110 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229041    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.229110 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229084    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-cnibin\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229114    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229148    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b72273f-bfd0-4091-86fe-aa32631c8311-tmp-dir\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229172    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqj4\" (UniqueName: \"kubernetes.io/projected/2b72273f-bfd0-4091-86fe-aa32631c8311-kube-api-access-2wqj4\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229190    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-slash\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229218    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229253 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229244    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-etc-tuned\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229268    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229292    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229317    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-script-lib\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229345    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-bin\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229374    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229399    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f23088c-3193-4be2-af40-c166d264fffc-ovn-node-metrics-cert\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229424    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-sys\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.229453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229447    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/523c938d-deb8-4c9c-b68f-af401372c576-host\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229468    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229475    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b72273f-bfd0-4091-86fe-aa32631c8311-tmp-dir\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229499    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229524    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-systemd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229540    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-slash\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229550    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-etc-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229575    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-node-log\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229594    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229598    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-run\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229636    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-host\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229706    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-node-log\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229718    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-bin\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.229746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229742    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229778    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr45g\" (UniqueName: \"kubernetes.io/projected/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-kube-api-access-nr45g\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229809    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-netns\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229834    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229839    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-systemd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229866    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-cnibin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.229810    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229893    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-system-cni-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229923    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-script-lib\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.229936    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-netns\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.230040    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.730018643 +0000 UTC m=+3.014873888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230062    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-etc-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230255    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.230284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230285    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-device-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230327    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230353    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-hostroot\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230379    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-daemon-config\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230406    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230436    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-systemd-units\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230423    2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230463    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/523c938d-deb8-4c9c-b68f-af401372c576-serviceca\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230474    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230527    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcm7r\" (UniqueName: \"kubernetes.io/projected/523c938d-deb8-4c9c-b68f-af401372c576-kube-api-access-jcm7r\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230582    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-systemd-units\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230581    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wbxm\" (UniqueName: \"kubernetes.io/projected/68d91463-8bf4-43e9-9489-b387548b79c9-kube-api-access-8wbxm\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230628    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-host-slash\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230656    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-system-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230691    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-conf-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230718    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-etc-kubernetes\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230753    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-dbus\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.230973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230780    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acab54ba-381a-4b30-9716-06a1f03336c0-konnectivity-ca\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230833    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-iptables-alerter-script\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230860    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-k8s-cni-cncf-io\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230888    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230919    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jds2t\" (UniqueName: \"kubernetes.io/projected/0f23088c-3193-4be2-af40-c166d264fffc-kube-api-access-jds2t\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.230978    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysconfig\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231013    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-conf\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231049    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-socket-dir-parent\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231078    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-multus-certs\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231110    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-os-release\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231141    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b72273f-bfd0-4091-86fe-aa32631c8311-hosts-file\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231190    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-modprobe-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231216    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-lib-modules\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231226    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b72273f-bfd0-4091-86fe-aa32631c8311-hosts-file\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231247    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/4b840f1e-593b-4b05-a68f-351d4d520308-kube-api-access-ns2kh\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231274    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-bin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.231729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231308    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-kubelet-config\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231338    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7l2\" (UniqueName: \"kubernetes.io/projected/22ce5b0c-4e82-44ab-bfba-c4d228197060-kube-api-access-4h7l2\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231367    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-netd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231403    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-cni-netd\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231404    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-config\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231456    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-systemd\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231482    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-var-lib-kubelet\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231499    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-tmp\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231532    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-netns\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231559    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-multus\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231583    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231620    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-kubelet\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231650    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231688    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmkt\" (UniqueName: \"kubernetes.io/projected/5c7ad2f8-0362-441c-8648-9407163cb1b3-kube-api-access-8wmkt\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231733    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-ovn\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231767    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-kubernetes\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231800    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-ovnkube-config\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.232430 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231800    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-run-ovn\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231840    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-var-lib-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231862    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-env-overrides\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231884    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-cni-binary-copy\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231902    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-var-lib-openvswitch\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.231977    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfg8\" (UniqueName: \"kubernetes.io/projected/a7a4971d-151d-4059-a1b8-7c007aa5772c-kube-api-access-ljfg8\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232003    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232031    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acab54ba-381a-4b30-9716-06a1f03336c0-agent-certs\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232059    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-kubelet\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232101    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-os-release\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232102    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f23088c-3193-4be2-af40-c166d264fffc-host-kubelet\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232127    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-binary-copy\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.233114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.232342    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f23088c-3193-4be2-af40-c166d264fffc-env-overrides\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.234928 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.234904    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f23088c-3193-4be2-af40-c166d264fffc-ovn-node-metrics-cert\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.239780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.238763    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqj4\" (UniqueName: \"kubernetes.io/projected/2b72273f-bfd0-4091-86fe-aa32631c8311-kube-api-access-2wqj4\") pod \"node-resolver-gxxz7\" (UID: \"2b72273f-bfd0-4091-86fe-aa32631c8311\") " pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.240799 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.240700    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jds2t\" (UniqueName: \"kubernetes.io/projected/0f23088c-3193-4be2-af40-c166d264fffc-kube-api-access-jds2t\") pod \"ovnkube-node-4sh2j\" (UID: \"0f23088c-3193-4be2-af40-c166d264fffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.243603 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.243582    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wbxm\" (UniqueName: \"kubernetes.io/projected/68d91463-8bf4-43e9-9489-b387548b79c9-kube-api-access-8wbxm\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.258274 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.258209    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal" event={"ID":"b5fc099c7007974686ef1fc33ec7465c","Type":"ContainerStarted","Data":"15d942d054602b37de18f866206f853f1557238867be8dd24f9873098d32387c"}
Jul 07 02:14:49.259975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.259939    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal" event={"ID":"126c0b745ca1a36f8c0674a19658885c","Type":"ContainerStarted","Data":"73a6d8ae8f94eb323a2b776d58630a87ee99318f4ba489873177e12b33f08944"}
Jul 07 02:14:49.332945 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.332853    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-run\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.332945 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.332897    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-host\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.332945 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.332923    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr45g\" (UniqueName: \"kubernetes.io/projected/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-kube-api-access-nr45g\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.332964    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.332991    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-cnibin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333007    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-run\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333012    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-host\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333015    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-system-cni-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333085    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333111    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-device-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333139    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-hostroot\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333163    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-daemon-config\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333182    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333180    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.333266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333250    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-cnibin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333052    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-system-cni-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333281    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/523c938d-deb8-4c9c-b68f-af401372c576-serviceca\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333315    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-device-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333326    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcm7r\" (UniqueName: \"kubernetes.io/projected/523c938d-deb8-4c9c-b68f-af401372c576-kube-api-access-jcm7r\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333362    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-host-slash\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333388    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-system-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333413    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-conf-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333446    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333449    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-etc-kubernetes\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333482    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-etc-kubernetes\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333487    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-dbus\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333516    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acab54ba-381a-4b30-9716-06a1f03336c0-konnectivity-ca\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333530    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-host-slash\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333545    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-iptables-alerter-script\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333572    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-k8s-cni-cncf-io\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333580    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-system-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.333930 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333599    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333613    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-conf-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333629    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysconfig\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333655    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-conf\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333678    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-socket-dir-parent\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333684    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/523c938d-deb8-4c9c-b68f-af401372c576-serviceca\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333702    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-multus-certs\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333738    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-hostroot\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333748    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-os-release\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333773    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-modprobe-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333820    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-lib-modules\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333847    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/4b840f1e-593b-4b05-a68f-351d4d520308-kube-api-access-ns2kh\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333891    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-bin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.333985    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-kubelet-config\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334039    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7l2\" (UniqueName: \"kubernetes.io/projected/22ce5b0c-4e82-44ab-bfba-c4d228197060-kube-api-access-4h7l2\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334067    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-systemd\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334112    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-var-lib-kubelet\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334136    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-tmp\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.334553 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334161    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-netns\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334197    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-multus\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334221    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334277    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-kubelet\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334292    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-daemon-config\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334304    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334327    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-iptables-alerter-script\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334364    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmkt\" (UniqueName: \"kubernetes.io/projected/5c7ad2f8-0362-441c-8648-9407163cb1b3-kube-api-access-8wmkt\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334390    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-kubernetes\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-cni-binary-copy\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334459    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfg8\" (UniqueName: \"kubernetes.io/projected/a7a4971d-151d-4059-a1b8-7c007aa5772c-kube-api-access-ljfg8\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334484    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-dbus\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334507    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334543    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acab54ba-381a-4b30-9716-06a1f03336c0-agent-certs\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.335224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334572    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-os-release\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.336824 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.336796    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.336988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.336881    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-k8s-cni-cncf-io\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.337581 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337499    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.337690 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337611    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysconfig\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.337756 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337743    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-sysctl-conf\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.337836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337809    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-socket-dir-parent\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.337905 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337876    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-multus-certs\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.338029 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.337984    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-os-release\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.338547 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.338133    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-modprobe-d\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.338674 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.338653    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-lib-modules\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.339108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.339060    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-bin\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.339213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.339173    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-kubelet-config\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.340080 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.339523    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-systemd\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.340080 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.339619    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-var-lib-kubelet\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.341600 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.341576    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-run-netns\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.341694 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.341666    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-cni-multus\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.341790 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.341767    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.341938 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.341924    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.841896699 +0000 UTC m=+3.126751955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.342249 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.342230    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-host-var-lib-kubelet\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.342340 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.342318    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.342835 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.334620    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-binary-copy\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.342968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.342842    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.342968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.342876    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-cnibin\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.342968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.342907    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.343142 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343012    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-etc-tuned\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.343142 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343062    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.343142 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343092    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acab54ba-381a-4b30-9716-06a1f03336c0-konnectivity-ca\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.343298 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343276    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.343357 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343319    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-sys\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.343424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343348    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-os-release\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.343424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343377    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/523c938d-deb8-4c9c-b68f-af401372c576-host\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.343535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343449    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.343535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343451    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/523c938d-deb8-4c9c-b68f-af401372c576-host\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.343627 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343595    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-sys\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.343687 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343636    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ce5b0c-4e82-44ab-bfba-c4d228197060-cni-binary-copy\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.343687 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343670    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.343963 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.343846    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.344214 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.344161    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a4971d-151d-4059-a1b8-7c007aa5772c-multus-cni-dir\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.344409 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.344382    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a4971d-151d-4059-a1b8-7c007aa5772c-cni-binary-copy\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.344721 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.344691    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.344837 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.344771    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b840f1e-593b-4b05-a68f-351d4d520308-etc-kubernetes\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.344837 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.344827    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ce5b0c-4e82-44ab-bfba-c4d228197060-cnibin\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.345274 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.345248    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c7ad2f8-0362-441c-8648-9407163cb1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.346953 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.346931    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-tmp\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.347130 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.347104    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acab54ba-381a-4b30-9716-06a1f03336c0-agent-certs\") pod \"konnectivity-agent-r64rk\" (UID: \"acab54ba-381a-4b30-9716-06a1f03336c0\") " pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.348320 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.348293    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b840f1e-593b-4b05-a68f-351d4d520308-etc-tuned\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.348534 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.348510    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr45g\" (UniqueName: \"kubernetes.io/projected/47e1d7d3-cb02-4234-8094-ebdcecdcdae2-kube-api-access-nr45g\") pod \"iptables-alerter-658g9\" (UID: \"47e1d7d3-cb02-4234-8094-ebdcecdcdae2\") " pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.350746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.350224    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7l2\" (UniqueName: \"kubernetes.io/projected/22ce5b0c-4e82-44ab-bfba-c4d228197060-kube-api-access-4h7l2\") pod \"multus-additional-cni-plugins-smm6b\" (UID: \"22ce5b0c-4e82-44ab-bfba-c4d228197060\") " pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.350746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.350506    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/4b840f1e-593b-4b05-a68f-351d4d520308-kube-api-access-ns2kh\") pod \"tuned-hmklh\" (UID: \"4b840f1e-593b-4b05-a68f-351d4d520308\") " pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.351755 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.351483    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:49.351755 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.351512    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:49.351755 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.351525    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:49.351755 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.351588    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.85157343 +0000 UTC m=+3.136428671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:49.353408 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.353383    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfg8\" (UniqueName: \"kubernetes.io/projected/a7a4971d-151d-4059-a1b8-7c007aa5772c-kube-api-access-ljfg8\") pod \"multus-hv4sq\" (UID: \"a7a4971d-151d-4059-a1b8-7c007aa5772c\") " pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.354821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.354100    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcm7r\" (UniqueName: \"kubernetes.io/projected/523c938d-deb8-4c9c-b68f-af401372c576-kube-api-access-jcm7r\") pod \"node-ca-cdzq5\" (UID: \"523c938d-deb8-4c9c-b68f-af401372c576\") " pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.354821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.354322    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmkt\" (UniqueName: \"kubernetes.io/projected/5c7ad2f8-0362-441c-8648-9407163cb1b3-kube-api-access-8wmkt\") pod \"aws-ebs-csi-driver-node-mkkdf\" (UID: \"5c7ad2f8-0362-441c-8648-9407163cb1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.431539 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.431490    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxxz7"
Jul 07 02:14:49.441873 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.441849    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:14:49.452866 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.452831    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:14:49.459024 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.458989    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smm6b"
Jul 07 02:14:49.467969 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.467927    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmklh"
Jul 07 02:14:49.481811 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.481782    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdzq5"
Jul 07 02:14:49.491091 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.491067    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf"
Jul 07 02:14:49.500547 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.500510    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-658g9"
Jul 07 02:14:49.505510 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.505482    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hv4sq"
Jul 07 02:14:49.747122 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.747023    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:49.747261 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.747197    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.747321 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.747284    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:50.7472612 +0000 UTC m=+4.032116458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.848165 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.848124    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:49.848357 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.848286    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.848357 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.848353    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:50.848334826 +0000 UTC m=+4.133190080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.948872 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:49.948833    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:49.949078 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.949016    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:49.949078 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.949038    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:49.949078 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.949052    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:49.949273 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:49.949111    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:50.949094776 +0000 UTC m=+4.233950038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:50.211301 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:50.211242    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:09:49 +0000 UTC" deadline="2028-01-17 22:43:09.45871646 +0000 UTC"
Jul 07 02:14:50.211301 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:50.211307    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13436h28m19.247414224s"
Jul 07 02:14:50.471470 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.471435    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523c938d_deb8_4c9c_b68f_af401372c576.slice/crio-6712cc0478ff0fe14ad7924b00036a8abcea134b4b484192e738aa6ea3663e29 WatchSource:0}: Error finding container 6712cc0478ff0fe14ad7924b00036a8abcea134b4b484192e738aa6ea3663e29: Status 404 returned error can't find the container with id 6712cc0478ff0fe14ad7924b00036a8abcea134b4b484192e738aa6ea3663e29
Jul 07 02:14:50.475917 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.475885    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7ad2f8_0362_441c_8648_9407163cb1b3.slice/crio-78c2a2614549ea6f62abc37caacade2518431fe571865048662763f0e1f74516 WatchSource:0}: Error finding container 78c2a2614549ea6f62abc37caacade2518431fe571865048662763f0e1f74516: Status 404 returned error can't find the container with id 78c2a2614549ea6f62abc37caacade2518431fe571865048662763f0e1f74516
Jul 07 02:14:50.479122 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.479091    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ce5b0c_4e82_44ab_bfba_c4d228197060.slice/crio-edd755decfd9beb8d6e6839c4cee6cd69942ed4f477377a844d6699e297f4db3 WatchSource:0}: Error finding container edd755decfd9beb8d6e6839c4cee6cd69942ed4f477377a844d6699e297f4db3: Status 404 returned error can't find the container with id edd755decfd9beb8d6e6839c4cee6cd69942ed4f477377a844d6699e297f4db3
Jul 07 02:14:50.483739 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.483715    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b72273f_bfd0_4091_86fe_aa32631c8311.slice/crio-c8cc36811f9280bcde4bec372e7fb79dd38c400db890eeff7b2b17dae5d1c137 WatchSource:0}: Error finding container c8cc36811f9280bcde4bec372e7fb79dd38c400db890eeff7b2b17dae5d1c137: Status 404 returned error can't find the container with id c8cc36811f9280bcde4bec372e7fb79dd38c400db890eeff7b2b17dae5d1c137
Jul 07 02:14:50.486561 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.486514    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacab54ba_381a_4b30_9716_06a1f03336c0.slice/crio-77656bcc681c190a98343337a143d48797102e38a4fe0dba54b9257a032993d8 WatchSource:0}: Error finding container 77656bcc681c190a98343337a143d48797102e38a4fe0dba54b9257a032993d8: Status 404 returned error can't find the container with id 77656bcc681c190a98343337a143d48797102e38a4fe0dba54b9257a032993d8
Jul 07 02:14:50.488979 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:14:50.488910    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e1d7d3_cb02_4234_8094_ebdcecdcdae2.slice/crio-2bc05f9001c6b2a527cea298aeb87a4c37d1166b3d48dd39a9d6e9b982464236 WatchSource:0}: Error finding container 2bc05f9001c6b2a527cea298aeb87a4c37d1166b3d48dd39a9d6e9b982464236: Status 404 returned error can't find the container with id 2bc05f9001c6b2a527cea298aeb87a4c37d1166b3d48dd39a9d6e9b982464236
Jul 07 02:14:50.756522 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:50.756494    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:50.756625 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.756612    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:50.756686 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.756669    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:52.756655572 +0000 UTC m=+6.041510814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:50.857721 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:50.857681    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:50.857920 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.857840    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:50.857920 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.857909    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:52.857892769 +0000 UTC m=+6.142748024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:50.958759 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:50.958718    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:50.958981 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.958957    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:50.959083 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.958989    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:50.959083 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.959000    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:50.959083 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:50.959058    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:52.959041135 +0000 UTC m=+6.243896375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:51.211501 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.211429    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:09:49 +0000 UTC" deadline="2028-02-08 13:21:24.12437085 +0000 UTC"
Jul 07 02:14:51.211501 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.211467    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13955h6m32.912907882s"
Jul 07 02:14:51.256260 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.256173    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:51.256516 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:51.256341    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:51.256804 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.256777    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:51.256914 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:51.256888    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:51.257049 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.256980    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:51.257139 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:51.257101    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:14:51.274360 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.274309    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxxz7" event={"ID":"2b72273f-bfd0-4091-86fe-aa32631c8311","Type":"ContainerStarted","Data":"c8cc36811f9280bcde4bec372e7fb79dd38c400db890eeff7b2b17dae5d1c137"}
Jul 07 02:14:51.286854 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.286731    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerStarted","Data":"edd755decfd9beb8d6e6839c4cee6cd69942ed4f477377a844d6699e297f4db3"}
Jul 07 02:14:51.293082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.293047    2545 generic.go:356] "Generic (PLEG): container finished" podID="126c0b745ca1a36f8c0674a19658885c" containerID="96c6d7c440015e54b6f2310b212f2d7fe776ff268de7ded74308dfed0bbec744" exitCode=0
Jul 07 02:14:51.293633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.293395    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal" event={"ID":"126c0b745ca1a36f8c0674a19658885c","Type":"ContainerDied","Data":"96c6d7c440015e54b6f2310b212f2d7fe776ff268de7ded74308dfed0bbec744"}
Jul 07 02:14:51.301591 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.301553    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmklh" event={"ID":"4b840f1e-593b-4b05-a68f-351d4d520308","Type":"ContainerStarted","Data":"1bb8e2a47a7604c66f2f5d4c582680fe8ccd256eb76e98ce5ce15c88fec4bccf"}
Jul 07 02:14:51.305508 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.305452    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf" event={"ID":"5c7ad2f8-0362-441c-8648-9407163cb1b3","Type":"ContainerStarted","Data":"78c2a2614549ea6f62abc37caacade2518431fe571865048662763f0e1f74516"}
Jul 07 02:14:51.322361 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.322319    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"59f799c5e1e891e602cce5210e1b7e64cd4838992778ad7dbc192229479551a9"}
Jul 07 02:14:51.330331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.330265    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdzq5" event={"ID":"523c938d-deb8-4c9c-b68f-af401372c576","Type":"ContainerStarted","Data":"6712cc0478ff0fe14ad7924b00036a8abcea134b4b484192e738aa6ea3663e29"}
Jul 07 02:14:51.333009 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.332955    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal" event={"ID":"b5fc099c7007974686ef1fc33ec7465c","Type":"ContainerStarted","Data":"8eb20196c17f854109d167890712473e352dd3e13b0c9f384327df47116eba08"}
Jul 07 02:14:51.345839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.345736    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-658g9" event={"ID":"47e1d7d3-cb02-4234-8094-ebdcecdcdae2","Type":"ContainerStarted","Data":"2bc05f9001c6b2a527cea298aeb87a4c37d1166b3d48dd39a9d6e9b982464236"}
Jul 07 02:14:51.360032 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.357687    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-16.ec2.internal" podStartSLOduration=2.357663373 podStartE2EDuration="2.357663373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:51.347546125 +0000 UTC m=+4.632401391" watchObservedRunningTime="2026-07-07 02:14:51.357663373 +0000 UTC m=+4.642518636"
Jul 07 02:14:51.368664 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.368547    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r64rk" event={"ID":"acab54ba-381a-4b30-9716-06a1f03336c0","Type":"ContainerStarted","Data":"77656bcc681c190a98343337a143d48797102e38a4fe0dba54b9257a032993d8"}
Jul 07 02:14:51.378166 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:51.378083    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hv4sq" event={"ID":"a7a4971d-151d-4059-a1b8-7c007aa5772c","Type":"ContainerStarted","Data":"c5a03fbb99c60d724c6f5c0d7c516b3d16418affaaa51e252a824da941b49219"}
Jul 07 02:14:52.413921 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:52.413871    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal" event={"ID":"126c0b745ca1a36f8c0674a19658885c","Type":"ContainerStarted","Data":"c3faed9c716747f872be4acc128ad4c9fe4e94f71e8edddc25521068da686856"}
Jul 07 02:14:52.773934 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:52.773852    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:52.774126 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.773988    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:52.774126 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.774059    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:56.774039624 +0000 UTC m=+10.058894869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:52.874726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:52.874685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:52.874948 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.874923    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:52.875230 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.875214    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:56.875187289 +0000 UTC m=+10.160042566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:52.976248 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:52.975555    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:52.976248 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.975734    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:52.976248 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.975754    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:52.976248 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.975768    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:52.976248 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:52.975829    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:56.975809857 +0000 UTC m=+10.260665100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:53.255742 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:53.255701    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:53.255986 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:53.255856    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:53.256363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:53.256105    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:53.256363 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:53.256221    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:14:53.256363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:53.256281    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:53.256363 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:53.256361    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:55.255407 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:55.255328    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:55.255776 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:55.255471    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:14:55.255776 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:55.255569    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:55.255776 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:55.255635    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:55.255776 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:55.255667    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:55.255776 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:55.255739    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:56.810225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:56.809432    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:56.810225 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:56.809657    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:56.810225 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:56.809727    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:04.809706629 +0000 UTC m=+18.094561873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:56.910366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:56.910313    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:56.910540 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:56.910486    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:56.910591 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:56.910543    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:04.910529401 +0000 UTC m=+18.195384642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:57.011037 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:57.010998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:57.011247 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.011157    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:57.011247 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.011183    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:57.011247 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.011195    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:57.011247 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.011246    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:15:05.011230047 +0000 UTC m=+18.296085291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:57.255143 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:57.255068    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:57.255276 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.255176    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:14:57.256103 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:57.256064    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:57.256237 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.256184    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:57.256237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:57.256076    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:57.256352 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:57.256279    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:59.254948 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:59.254900    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:14:59.255397 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:59.255047    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:14:59.255473 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:59.255422    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:14:59.255528 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:59.255515    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:14:59.255669 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:14:59.255653    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:14:59.255770 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:14:59.255754    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:01.255078 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:01.255037    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:01.255539 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:01.255040    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:01.255539 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:01.255175    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:01.255539 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:01.255171    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:01.255539 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:01.255311    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:01.255539 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:01.255408    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:03.253578 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:03.253536    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:03.254010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:03.253536    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:03.254010 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:03.253663    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:03.254010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:03.253547    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:03.254010 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:03.253747    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:03.254010 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:03.253827    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:04.871242 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:04.871203    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:04.871748 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:04.871345    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:04.871748 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:04.871406    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:20.871388706 +0000 UTC m=+34.156243947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:04.971704 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:04.971664    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:04.971885 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:04.971836    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:04.971970 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:04.971912    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:20.971891637 +0000 UTC m=+34.256746884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:05.073179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:05.073135    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:05.073364 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.073335    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:15:05.073364 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.073364    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:15:05.073486 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.073376    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:05.073486 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.073434    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:15:21.073416295 +0000 UTC m=+34.358271535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:05.253611 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:05.253530    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:05.253753 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:05.253530    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:05.253753 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.253649    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:05.253753 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.253706    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:05.253753 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:05.253538    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:05.253932 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:05.253841    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:07.253618 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:07.253580    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:07.254108 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:07.253700    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:07.254108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:07.253784    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:07.254108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:07.253885    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:07.254108 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:07.253934    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:07.254108 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:07.253981    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:09.253162 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:09.253127    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:09.253732 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:09.253138    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:09.253732 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:09.253272    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:09.253732 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:09.253147    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:09.253732 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:09.253323    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:09.253732 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:09.253381    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:11.253203 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.252953    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:11.253907 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:11.253234    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:11.253907 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.252999    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:11.253907 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:11.253408    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:11.253907 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.253506    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:11.253907 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:11.253599    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:11.452654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.452616    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmklh" event={"ID":"4b840f1e-593b-4b05-a68f-351d4d520308","Type":"ContainerStarted","Data":"e02f5f7f698ecb2d5074bf12913f6201fdb058b6335860fdf6b60d4b3383f926"}
Jul 07 02:15:11.454817 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.454783    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf" event={"ID":"5c7ad2f8-0362-441c-8648-9407163cb1b3","Type":"ContainerStarted","Data":"947c84c98375916753b3d6134f00788bada932d60fa0c289d1a0266f6350c7cd"}
Jul 07 02:15:11.458358 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458332    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"235763af48e06fa290249677ab180c6cac6f765660a61261474fade9db74b254"}
Jul 07 02:15:11.458502 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458408    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"210b82bdfe06fbc0f0e8730fe7b746b39c92f5f9be2b2f4a88bbb32d55d515a6"}
Jul 07 02:15:11.458502 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458461    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"4798d56d471cc2f3c700e2ef79c6ce08ac9e726e880c125addeccee9f3a26629"}
Jul 07 02:15:11.458614 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458509    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"be1d930698f90dd11c53bb48a3ee52cc4e90e376099c85cf1a469b8ecc9c0a2e"}
Jul 07 02:15:11.458614 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458557    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"e6c12b018969f6242fec92ace426723e7c76a17a577d8e16089ddd4ec5028f6b"}
Jul 07 02:15:11.458614 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.458606    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"329f71944a97246041edadfb3cb782cf22dc150a8e736b96722a1f6f4d4597c6"}
Jul 07 02:15:11.459984 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.459953    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdzq5" event={"ID":"523c938d-deb8-4c9c-b68f-af401372c576","Type":"ContainerStarted","Data":"e3922100881a39aaf342d229ad9d2be5f14fbfdd82b0eaf66d84dc1ee3d9fde4"}
Jul 07 02:15:11.461552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.461526    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r64rk" event={"ID":"acab54ba-381a-4b30-9716-06a1f03336c0","Type":"ContainerStarted","Data":"ef8c166036f97f0ff4e9c949e22dec316559a4baa1bae34c0dc3cce24ca2e18c"}
Jul 07 02:15:11.463145 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.463117    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hv4sq" event={"ID":"a7a4971d-151d-4059-a1b8-7c007aa5772c","Type":"ContainerStarted","Data":"b958069092f69522aa0044a57231f3d3a233734fb773233a0f76e977f4b44cc8"}
Jul 07 02:15:11.464639 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.464617    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxxz7" event={"ID":"2b72273f-bfd0-4091-86fe-aa32631c8311","Type":"ContainerStarted","Data":"1feaa18f48fd5b3e366be3b2e1904972180d3a7057dac719b963c5d46eac6df9"}
Jul 07 02:15:11.466306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.466282    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="b2ff0869ac65b4571d24a11018077cfdc3bd452ae762e72ab162642c2eb3dbe5" exitCode=0
Jul 07 02:15:11.466391 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.466323    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"b2ff0869ac65b4571d24a11018077cfdc3bd452ae762e72ab162642c2eb3dbe5"}
Jul 07 02:15:11.469699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.469653    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hmklh" podStartSLOduration=3.448983539 podStartE2EDuration="23.469637189s" totalImagesPullingTime="20.02065365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.46919161 +0000 UTC m=+24.754046871" watchObservedRunningTime="2026-07-07 02:15:11.469637189 +0000 UTC m=+24.754492451"
Jul 07 02:15:11.469897 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.469867    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-16.ec2.internal" podStartSLOduration=22.46985975 podStartE2EDuration="22.46985975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:52.431450026 +0000 UTC m=+5.716305291" watchObservedRunningTime="2026-07-07 02:15:11.46985975 +0000 UTC m=+24.754715011"
Jul 07 02:15:11.482790 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.482745    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r64rk" podStartSLOduration=3.47268754 podStartE2EDuration="23.482728504s" totalImagesPullingTime="20.010040964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.482704553 +0000 UTC m=+24.767559814" watchObservedRunningTime="2026-07-07 02:15:11.482728504 +0000 UTC m=+24.767583765"
Jul 07 02:15:11.495551 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.495505    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gxxz7" podStartSLOduration=3.480729389 podStartE2EDuration="23.495493124s" totalImagesPullingTime="20.014763735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.495028624 +0000 UTC m=+24.779883885" watchObservedRunningTime="2026-07-07 02:15:11.495493124 +0000 UTC m=+24.780348384"
Jul 07 02:15:11.508630 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.508519    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cdzq5" podStartSLOduration=3.479597202 podStartE2EDuration="23.508504173s" totalImagesPullingTime="20.028906971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.507738081 +0000 UTC m=+24.792593342" watchObservedRunningTime="2026-07-07 02:15:11.508504173 +0000 UTC m=+24.793359557"
Jul 07 02:15:11.523048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.522993    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hv4sq" podStartSLOduration=3.444868494 podStartE2EDuration="23.522973763s" totalImagesPullingTime="20.078105269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.522532671 +0000 UTC m=+24.807387932" watchObservedRunningTime="2026-07-07 02:15:11.522973763 +0000 UTC m=+24.807829025"
Jul 07 02:15:11.844406 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:11.844193    2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 02:15:12.256456 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.256341    2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T02:15:11.84440013Z","UUID":"e175b42d-bb4d-4403-8c5f-5a016b095213","Handler":null,"Name":"","Endpoint":""}
Jul 07 02:15:12.258020 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.257997    2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 02:15:12.258169 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.258052    2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 02:15:12.470740 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.470698    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf" event={"ID":"5c7ad2f8-0362-441c-8648-9407163cb1b3","Type":"ContainerStarted","Data":"86c0f8707c7f4b95dc71488dc0e862010f01387a3f93ab84c4458b18c6aad628"}
Jul 07 02:15:12.472568 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.472537    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-658g9" event={"ID":"47e1d7d3-cb02-4234-8094-ebdcecdcdae2","Type":"ContainerStarted","Data":"d27610eddbc15ba47b39520da0ab6272cc1b69993f3bbd4f54614206cfa51655"}
Jul 07 02:15:12.488263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:12.488207    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-658g9" podStartSLOduration=4.469053924 podStartE2EDuration="24.488191216s" totalImagesPullingTime="20.019137292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:12.487721613 +0000 UTC m=+25.772576877" watchObservedRunningTime="2026-07-07 02:15:12.488191216 +0000 UTC m=+25.773046488"
Jul 07 02:15:13.252973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.252911    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:13.252973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.252974    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:13.253196 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.252944    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:13.253196 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:13.253052    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:13.253196 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:13.253149    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:13.253350 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:13.253191    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:13.477312 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.477282    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf" event={"ID":"5c7ad2f8-0362-441c-8648-9407163cb1b3","Type":"ContainerStarted","Data":"8584e4a8f05991245e72c46218861a83efcedadbe1a2e9a6eabbc7d1abc77cdd"}
Jul 07 02:15:13.480518 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.480491    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"c0d0364e7635646fab15d712b3b310dcc52f82bc0f0fb7b2793946b6036a27fa"}
Jul 07 02:15:13.493042 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.492996    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkkdf" podStartSLOduration=3.299916795 podStartE2EDuration="25.49298017s" totalImagesPullingTime="22.193063375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:13.492952774 +0000 UTC m=+26.777808035" watchObservedRunningTime="2026-07-07 02:15:13.49298017 +0000 UTC m=+26.777835430"
Jul 07 02:15:13.653790 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.653753    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:15:13.654381 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:13.654358    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:15:14.482369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:14.482339    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:15:14.483021 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:14.483004    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r64rk"
Jul 07 02:15:15.253105 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:15.253069    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:15.253275 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:15.253069    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:15.253275 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:15.253172    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:15.253275 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:15.253069    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:15.253275 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:15.253260    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:15.253446 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:15.253366    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:16.491747 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:16.491504    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" event={"ID":"0f23088c-3193-4be2-af40-c166d264fffc","Type":"ContainerStarted","Data":"8891b07558f9ed1abf58059d7eaa5ae794feb9842607ab76e51240f6b9839f56"}
Jul 07 02:15:16.522654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:16.522596    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j" podStartSLOduration=8.434274904 podStartE2EDuration="28.522578337s" totalImagesPullingTime="20.088303433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:16.522274542 +0000 UTC m=+29.807129808" watchObservedRunningTime="2026-07-07 02:15:16.522578337 +0000 UTC m=+29.807433598"
Jul 07 02:15:17.254845 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.254805    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:17.255053 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.254946    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:17.255053 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.254975    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:17.255053 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.254967    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:17.255053 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.255047    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:17.255275 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.255141    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:17.493906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.493864    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:17.494306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.493986    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:17.494306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.494025    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:17.510860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.510638    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:17.511040 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.511025    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:17.526151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.526122    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5g2xh"]
Jul 07 02:15:17.526298 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.526241    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:17.526347 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.526332    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:17.530202 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.530176    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gmps"]
Jul 07 02:15:17.530339 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.530283    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:17.530419 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.530398    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:17.530765 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.530746    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24xlz"]
Jul 07 02:15:17.530856 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:17.530842    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:17.530969 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:17.530950    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:18.497587 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:18.497555    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="6c27bf7d1f031dd6ae60da4d29f69d346ec4ceb8040a6e5ec97067736ece3b57" exitCode=0
Jul 07 02:15:18.498104 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:18.497649    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"6c27bf7d1f031dd6ae60da4d29f69d346ec4ceb8040a6e5ec97067736ece3b57"}
Jul 07 02:15:19.253519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:19.253479    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:19.253519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:19.253517    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:19.253734 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:19.253607    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:19.253734 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:19.253644    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:19.253734 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:19.253724    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:19.253819 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:19.253769    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:20.504112 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:20.504030    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="3e427f53c113f20bf3701cbc055f7b927bb7f99dab6bf97cd310c6438f7f9706" exitCode=0
Jul 07 02:15:20.504112 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:20.504077    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"3e427f53c113f20bf3701cbc055f7b927bb7f99dab6bf97cd310c6438f7f9706"}
Jul 07 02:15:20.890284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:20.890236    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:20.890439 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:20.890390    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:20.890495 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:20.890459    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:52.890441291 +0000 UTC m=+66.175296549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:20.991014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:20.990973    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:20.991185 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:20.991100    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:20.991185 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:20.991158    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret podName:f99f9e07-bfaf-436e-91c3-b0a6e03d85b6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:52.991141973 +0000 UTC m=+66.275997214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret") pod "global-pull-secret-syncer-5g2xh" (UID: "f99f9e07-bfaf-436e-91c3-b0a6e03d85b6") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:21.091695 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.091652    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:21.091868 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.091838    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:15:21.091868 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.091861    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:15:21.091868 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.091870    2545 projected.go:196] Error preparing data for projected volume kube-api-access-mv97s for pod openshift-network-diagnostics/network-check-target-24xlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:21.092029 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.091951    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s podName:6d9392bd-c0da-40ad-afb9-63469a3d9f6e nodeName:}" failed. No retries permitted until 2026-07-07 02:15:53.091911864 +0000 UTC m=+66.376767169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv97s" (UniqueName: "kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s") pod "network-check-target-24xlz" (UID: "6d9392bd-c0da-40ad-afb9-63469a3d9f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:21.253419 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.253388    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:21.253529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.253426    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:21.253529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.253388    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:21.253529 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.253516    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:21.253692 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.253587    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:21.253692 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:21.253636    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:21.509114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.509027    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="c1d958d5c423220fd5d2f7f1ed6ce172355218c4c5800b232fb624365d5a70d5" exitCode=0
Jul 07 02:15:21.509114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:21.509086    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"c1d958d5c423220fd5d2f7f1ed6ce172355218c4c5800b232fb624365d5a70d5"}
Jul 07 02:15:23.254116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:23.253906    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:23.254583 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:23.254190    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24xlz" podUID="6d9392bd-c0da-40ad-afb9-63469a3d9f6e"
Jul 07 02:15:23.254583 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:23.254010    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:23.254583 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:23.254268    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g2xh" podUID="f99f9e07-bfaf-436e-91c3-b0a6e03d85b6"
Jul 07 02:15:23.254583 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:23.253906    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:23.254583 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:23.254343    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:15:24.473050 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.472979    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-16.ec2.internal" event="NodeReady"
Jul 07 02:15:24.473415 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.473115    2545 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 02:15:24.514638 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.514599    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nhqvq"]
Jul 07 02:15:24.518391 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.517772    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.518391 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.517949    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b6gst"]
Jul 07 02:15:24.520055 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.520028    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 02:15:24.520339 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.520315    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\""
Jul 07 02:15:24.520441 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.520315    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 02:15:24.522529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.522510    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.524352 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.524334    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 02:15:24.525836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.524708    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpvcs\""
Jul 07 02:15:24.525836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.524783    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 02:15:24.525836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.524783    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 02:15:24.526289 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.526266    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nhqvq"]
Jul 07 02:15:24.529601 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.529578    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b6gst"]
Jul 07 02:15:24.618667 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618632    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cdht\" (UniqueName: \"kubernetes.io/projected/7b643258-d8d2-47db-9d4f-a9500678120f-kube-api-access-5cdht\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.618836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618705    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b643258-d8d2-47db-9d4f-a9500678120f-cert\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.618836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618729    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.618836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618746    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aef31f0-20ee-4f9c-853f-5998579dc0c6-tmp-dir\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.618836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618799    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htglm\" (UniqueName: \"kubernetes.io/projected/0aef31f0-20ee-4f9c-853f-5998579dc0c6-kube-api-access-htglm\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.618836 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.618825    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0aef31f0-20ee-4f9c-853f-5998579dc0c6-config-volume\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720050 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720014    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htglm\" (UniqueName: \"kubernetes.io/projected/0aef31f0-20ee-4f9c-853f-5998579dc0c6-kube-api-access-htglm\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720231 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720066    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0aef31f0-20ee-4f9c-853f-5998579dc0c6-config-volume\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720422 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720404    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cdht\" (UniqueName: \"kubernetes.io/projected/7b643258-d8d2-47db-9d4f-a9500678120f-kube-api-access-5cdht\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.720484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720472    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b643258-d8d2-47db-9d4f-a9500678120f-cert\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.720523 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720490    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720523 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720509    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aef31f0-20ee-4f9c-853f-5998579dc0c6-tmp-dir\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720681 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720663    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0aef31f0-20ee-4f9c-853f-5998579dc0c6-config-volume\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.720763    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aef31f0-20ee-4f9c-853f-5998579dc0c6-tmp-dir\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.720843 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:24.720832    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:24.720880 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:24.720876    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:25.220861737 +0000 UTC m=+38.505716978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:24.724872 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.724822    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b643258-d8d2-47db-9d4f-a9500678120f-cert\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.728611 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.728590    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htglm\" (UniqueName: \"kubernetes.io/projected/0aef31f0-20ee-4f9c-853f-5998579dc0c6-kube-api-access-htglm\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:24.728871 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.728856    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cdht\" (UniqueName: \"kubernetes.io/projected/7b643258-d8d2-47db-9d4f-a9500678120f-kube-api-access-5cdht\") pod \"ingress-canary-b6gst\" (UID: \"7b643258-d8d2-47db-9d4f-a9500678120f\") " pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:24.838133 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:24.838103    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b6gst"
Jul 07 02:15:25.053114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.053076    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b6gst"]
Jul 07 02:15:25.058948 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:15:25.058450    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b643258_d8d2_47db_9d4f_a9500678120f.slice/crio-9c5fc08a5d72e9d54fcfc5599a6148c4c9058bd155c48c1f7f38d3ad193ec51e WatchSource:0}: Error finding container 9c5fc08a5d72e9d54fcfc5599a6148c4c9058bd155c48c1f7f38d3ad193ec51e: Status 404 returned error can't find the container with id 9c5fc08a5d72e9d54fcfc5599a6148c4c9058bd155c48c1f7f38d3ad193ec51e
Jul 07 02:15:25.226400 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.226369    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:25.226605 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:25.226546    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:25.226678 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:25.226626    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:26.226604551 +0000 UTC m=+39.511459793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:25.253322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.253231    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:25.253322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.253265    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:25.253538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.253238    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:25.256263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.256238    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\""
Jul 07 02:15:25.256792 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.256773    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:15:25.257257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.257237    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\""
Jul 07 02:15:25.259202 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.259183    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:15:25.259303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.259268    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:15:25.259303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.259286    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:15:25.519657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:25.519565    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b6gst" event={"ID":"7b643258-d8d2-47db-9d4f-a9500678120f","Type":"ContainerStarted","Data":"9c5fc08a5d72e9d54fcfc5599a6148c4c9058bd155c48c1f7f38d3ad193ec51e"}
Jul 07 02:15:26.234683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:26.234646    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:26.234862 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:26.234789    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:26.234862 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:26.234861    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:28.234839006 +0000 UTC m=+41.519694262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:27.528038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:27.527720    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="5667ff05241874d50b76bd9cf9c7db73591912361cbb4e0e4346ac69d31cc66a" exitCode=0
Jul 07 02:15:27.528038 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:27.527779    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"5667ff05241874d50b76bd9cf9c7db73591912361cbb4e0e4346ac69d31cc66a"}
Jul 07 02:15:28.249927 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:28.249888    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:28.250129 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:28.250055    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:28.250195 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:28.250136    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:32.250112598 +0000 UTC m=+45.534967845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:28.534807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:28.534769    2545 generic.go:356] "Generic (PLEG): container finished" podID="22ce5b0c-4e82-44ab-bfba-c4d228197060" containerID="a300b9bf87273e5c722a594753e2e7348766636557904f4b9837f8b795394fe8" exitCode=0
Jul 07 02:15:28.535493 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:28.534836    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerDied","Data":"a300b9bf87273e5c722a594753e2e7348766636557904f4b9837f8b795394fe8"}
Jul 07 02:15:29.541543 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:29.541450    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smm6b" event={"ID":"22ce5b0c-4e82-44ab-bfba-c4d228197060","Type":"ContainerStarted","Data":"796dfa92ac8ad9eae49ee560c9c5e8fc8156bd03906c91e12f7f2a1842055cc5"}
Jul 07 02:15:29.543804 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:29.543771    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b6gst" event={"ID":"7b643258-d8d2-47db-9d4f-a9500678120f","Type":"ContainerStarted","Data":"0f289b003354cfce46af5fd7a673481d1b31c1bcd03df1718d4487ff7e601b7c"}
Jul 07 02:15:29.562777 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:29.562723    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-smm6b" podStartSLOduration=8.263951721 podStartE2EDuration="41.562706273s" totalImagesPullingTime="33.298754552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:29.561687156 +0000 UTC m=+42.846542416" watchObservedRunningTime="2026-07-07 02:15:29.562706273 +0000 UTC m=+42.847561534"
Jul 07 02:15:29.575315 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:29.575264    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b6gst" podStartSLOduration=1.372103731 podStartE2EDuration="5.575248871s" totalImagesPullingTime="4.20314514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:29.574829618 +0000 UTC m=+42.859684880" watchObservedRunningTime="2026-07-07 02:15:29.575248871 +0000 UTC m=+42.860104110"
Jul 07 02:15:32.280940 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:32.280885    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:32.281325 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:32.281038    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:32.281325 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:32.281101    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:40.281083388 +0000 UTC m=+53.565938628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:40.338211 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:40.338169    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:40.338691 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:40.338332    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:40.338691 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:40.338397    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:56.338380811 +0000 UTC m=+69.623236052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:49.511224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:49.511199    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sh2j"
Jul 07 02:15:52.925597 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:52.925550    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:15:52.928139 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:52.928117    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:15:52.936805 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:52.936780    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:15:52.936909 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:52.936877    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:56.936852592 +0000 UTC m=+130.221707853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : secret "metrics-daemon-secret" not found
Jul 07 02:15:53.026546 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.026497    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:53.029100 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.029081    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:15:53.040314 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.040289    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99f9e07-bfaf-436e-91c3-b0a6e03d85b6-original-pull-secret\") pod \"global-pull-secret-syncer-5g2xh\" (UID: \"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6\") " pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:53.127003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.126955    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:53.129481 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.129462    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:15:53.140064 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.140035    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:15:53.150991 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.150957    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv97s\" (UniqueName: \"kubernetes.io/projected/6d9392bd-c0da-40ad-afb9-63469a3d9f6e-kube-api-access-mv97s\") pod \"network-check-target-24xlz\" (UID: \"6d9392bd-c0da-40ad-afb9-63469a3d9f6e\") " pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:53.171590 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.169169    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\""
Jul 07 02:15:53.176978 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.176901    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:53.180900 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.180766    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g2xh"
Jul 07 02:15:53.331271 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.331156    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5g2xh"]
Jul 07 02:15:53.335791 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:15:53.335763    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99f9e07_bfaf_436e_91c3_b0a6e03d85b6.slice/crio-c2d1407dc7cffaf112f957000a84e02a8f1e675659761796c241a85e2c76e7f9 WatchSource:0}: Error finding container c2d1407dc7cffaf112f957000a84e02a8f1e675659761796c241a85e2c76e7f9: Status 404 returned error can't find the container with id c2d1407dc7cffaf112f957000a84e02a8f1e675659761796c241a85e2c76e7f9
Jul 07 02:15:53.347722 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.347694    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24xlz"]
Jul 07 02:15:53.351310 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:15:53.351282    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9392bd_c0da_40ad_afb9_63469a3d9f6e.slice/crio-3d2f0bbd76fd5c660b5f318ada0dcdb22aa6b2f74131eb2b1fbbc5cda3f07f6f WatchSource:0}: Error finding container 3d2f0bbd76fd5c660b5f318ada0dcdb22aa6b2f74131eb2b1fbbc5cda3f07f6f: Status 404 returned error can't find the container with id 3d2f0bbd76fd5c660b5f318ada0dcdb22aa6b2f74131eb2b1fbbc5cda3f07f6f
Jul 07 02:15:53.599907 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.599865    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5g2xh" event={"ID":"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6","Type":"ContainerStarted","Data":"c2d1407dc7cffaf112f957000a84e02a8f1e675659761796c241a85e2c76e7f9"}
Jul 07 02:15:53.600906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:53.600883    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24xlz" event={"ID":"6d9392bd-c0da-40ad-afb9-63469a3d9f6e","Type":"ContainerStarted","Data":"3d2f0bbd76fd5c660b5f318ada0dcdb22aa6b2f74131eb2b1fbbc5cda3f07f6f"}
Jul 07 02:15:56.349322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:56.349275    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:15:56.349757 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:56.349435    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:56.349757 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:15:56.349539    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:28.34951333 +0000 UTC m=+101.634368590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:58.616817 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:58.615409    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5g2xh" event={"ID":"f99f9e07-bfaf-436e-91c3-b0a6e03d85b6","Type":"ContainerStarted","Data":"6cc4bc754d99f7367c286481eed466065cfcfd0f2a93a13cfbab00c2ce1b9850"}
Jul 07 02:15:58.617785 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:58.617758    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24xlz" event={"ID":"6d9392bd-c0da-40ad-afb9-63469a3d9f6e","Type":"ContainerStarted","Data":"8c3cc015a6634e620cf508bfbfeda27e17c605f8413f7e5d26b598e0db9bf94e"}
Jul 07 02:15:58.617889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:58.617821    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:15:58.630422 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:58.630371    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5g2xh" podStartSLOduration=66.065173361 podStartE2EDuration="1m10.630356364s" totalImagesPullingTime="4.565183003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:58.629371032 +0000 UTC m=+71.914226305" watchObservedRunningTime="2026-07-07 02:15:58.630356364 +0000 UTC m=+71.915211625"
Jul 07 02:15:58.643014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:15:58.642961    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-24xlz" podStartSLOduration=66.096346283 podStartE2EDuration="1m10.642940458s" totalImagesPullingTime="4.546594175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:58.642102811 +0000 UTC m=+71.926958072" watchObservedRunningTime="2026-07-07 02:15:58.642940458 +0000 UTC m=+71.927795710"
Jul 07 02:16:28.378508 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:16:28.378467    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:16:28.378983 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:16:28.378576    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:16:28.378983 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:16:28.378639    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:32.378625336 +0000 UTC m=+165.663480579 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:16:29.623286 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:16:29.623258    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-24xlz"
Jul 07 02:16:56.971781 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:16:56.971744    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:16:56.972277 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:16:56.971877    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:16:56.972277 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:16:56.971957    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:58.971936679 +0000 UTC m=+252.256791932 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : secret "metrics-daemon-secret" not found
Jul 07 02:17:27.532109 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:17:27.532019    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nhqvq" podUID="0aef31f0-20ee-4f9c-853f-5998579dc0c6"
Jul 07 02:17:27.826563 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:17:27.826532    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:17:28.274494 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:17:28.274398    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:17:32.419066 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:17:32.419019    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:17:32.419533 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:17:32.419180    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:17:32.419533 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:17:32.419247    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls podName:0aef31f0-20ee-4f9c-853f-5998579dc0c6 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:34.419228567 +0000 UTC m=+287.704083811 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls") pod "dns-default-nhqvq" (UID: "0aef31f0-20ee-4f9c-853f-5998579dc0c6") : secret "dns-default-metrics-tls" not found
Jul 07 02:17:42.253593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:17:42.253558    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:18:58.985702 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:18:58.985648    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:18:58.986304 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:18:58.985784    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:18:58.986304 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:18:58.985860    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs podName:68d91463-8bf4-43e9-9489-b387548b79c9 nodeName:}" failed. No retries permitted until 2026-07-07 02:21:00.98583628 +0000 UTC m=+374.270691540 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs") pod "network-metrics-daemon-7gmps" (UID: "68d91463-8bf4-43e9-9489-b387548b79c9") : secret "metrics-daemon-secret" not found
Jul 07 02:19:15.917599 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.917513    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-x9lf8"]
Jul 07 02:19:15.919302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.919288    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:15.921776 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.921752    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"]
Jul 07 02:19:15.922546 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.922513    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 02:19:15.923382 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.923365    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:15.923479 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.923411    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 02:19:15.923535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.923411    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-klxpj\""
Jul 07 02:19:15.923879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.923863    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 02:19:15.925711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.925691    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 02:19:15.925794 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.925722    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 02:19:15.925846 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.925790    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 02:19:15.926119 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.926098    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 02:19:15.926241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.926129    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:19:15.926241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.926098    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7nf89\""
Jul 07 02:19:15.929344 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.929325    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 02:19:15.942764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.942740    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-x9lf8"]
Jul 07 02:19:15.943460 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:15.943438    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"]
Jul 07 02:19:16.003809 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.003778    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-snapshots\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.004013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.003815    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.004013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.003835    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebe98e6e-062b-456d-8f26-7636c1597043-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.004013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.003913    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b75h8\" (UniqueName: \"kubernetes.io/projected/ebe98e6e-062b-456d-8f26-7636c1597043-kube-api-access-b75h8\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.004013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.003962    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebe98e6e-062b-456d-8f26-7636c1597043-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.004013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.004003    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-tmp\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.004179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.004018    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bef91ec5-453d-4036-8326-53ba11b6d928-serving-cert\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.004179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.004046    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjc9r\" (UniqueName: \"kubernetes.io/projected/bef91ec5-453d-4036-8326-53ba11b6d928-kube-api-access-kjc9r\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.004179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.004075    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.010059 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.010033    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"]
Jul 07 02:19:16.012035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.012019    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"
Jul 07 02:19:16.013975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.013913    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"]
Jul 07 02:19:16.014399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.014382    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-plmjl\""
Jul 07 02:19:16.015726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.015710    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.018220 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.018187    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 02:19:16.018516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.018498    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 02:19:16.018726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.018504    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-26x6k\""
Jul 07 02:19:16.019289 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.019115    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:19:16.019289 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.019119    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 02:19:16.019558 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.019480    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-688bb557ff-hjz8t"]
Jul 07 02:19:16.021415 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.021398    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:19:16.021527 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.021514    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.022977 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.022959    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.025306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.025287    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 02:19:16.027948 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.027912    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 02:19:16.028045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028002    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 02:19:16.028045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.027912    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 02:19:16.028045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028006    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgmf6\""
Jul 07 02:19:16.028284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028266    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 02:19:16.028348 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028296    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 02:19:16.028691 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028639    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 02:19:16.028788 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028723    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 02:19:16.028853 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028796    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 02:19:16.028853 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.028849    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pv7ql\""
Jul 07 02:19:16.029107 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.029088    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"]
Jul 07 02:19:16.038676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.038646    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 02:19:16.039195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.039176    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"]
Jul 07 02:19:16.046695 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.046671    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-688bb557ff-hjz8t"]
Jul 07 02:19:16.055881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.055853    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:19:16.104796 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.104762    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bef91ec5-453d-4036-8326-53ba11b6d928-serving-cert\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.104796 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.104795    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq5r\" (UniqueName: \"kubernetes.io/projected/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-kube-api-access-bzq5r\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.105069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.104823    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.104948    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.104993    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105016    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105043    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105080    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzh8\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105102    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-tmp\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105120    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjc9r\" (UniqueName: \"kubernetes.io/projected/bef91ec5-453d-4036-8326-53ba11b6d928-kube-api-access-kjc9r\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105136    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-default-certificate\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105153    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105168    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xr5\" (UniqueName: \"kubernetes.io/projected/c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3-kube-api-access-t9xr5\") pod \"network-check-source-989f8b8dc-zgtv7\" (UID: \"c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105220    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9320bd7-3a62-499a-a12b-0ea85ca89dba-config\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105237    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105262    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9320bd7-3a62-499a-a12b-0ea85ca89dba-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105292    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-snapshots\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.105332 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105325    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebe98e6e-062b-456d-8f26-7636c1597043-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105486    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktdgt\" (UniqueName: \"kubernetes.io/projected/a9320bd7-3a62-499a-a12b-0ea85ca89dba-kube-api-access-ktdgt\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105498    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-tmp\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105550    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105595    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b75h8\" (UniqueName: \"kubernetes.io/projected/ebe98e6e-062b-456d-8f26-7636c1597043-kube-api-access-b75h8\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105619    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105653    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebe98e6e-062b-456d-8f26-7636c1597043-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105677    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105703    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-stats-auth\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105728    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105868    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebe98e6e-062b-456d-8f26-7636c1597043-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.105880    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bef91ec5-453d-4036-8326-53ba11b6d928-snapshots\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.106101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.106021    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.106712 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.106147    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bef91ec5-453d-4036-8326-53ba11b6d928-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.107556 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.107537    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bef91ec5-453d-4036-8326-53ba11b6d928-serving-cert\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.107837 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.107819    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebe98e6e-062b-456d-8f26-7636c1597043-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.113545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.113517    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjc9r\" (UniqueName: \"kubernetes.io/projected/bef91ec5-453d-4036-8326-53ba11b6d928-kube-api-access-kjc9r\") pod \"insights-operator-5c847dcfc4-x9lf8\" (UID: \"bef91ec5-453d-4036-8326-53ba11b6d928\") " pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.113673 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.113537    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b75h8\" (UniqueName: \"kubernetes.io/projected/ebe98e6e-062b-456d-8f26-7636c1597043-kube-api-access-b75h8\") pod \"kube-storage-version-migrator-operator-846bf668f7-95gh9\" (UID: \"ebe98e6e-062b-456d-8f26-7636c1597043\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.207035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.206953    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.206990    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzh8\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207008    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-default-certificate\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.207035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207024    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xr5\" (UniqueName: \"kubernetes.io/projected/c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3-kube-api-access-t9xr5\") pod \"network-check-source-989f8b8dc-zgtv7\" (UID: \"c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.207102    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.207123    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd57f98cd-8xkjp: secret "image-registry-tls" not found
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207133    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9320bd7-3a62-499a-a12b-0ea85ca89dba-config\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.207175    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls podName:23064df1-5fa7-45ea-85d6-7d720bf2950e nodeName:}" failed. No retries permitted until 2026-07-07 02:19:16.707159069 +0000 UTC m=+269.992014308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls") pod "image-registry-6fd57f98cd-8xkjp" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e") : secret "image-registry-tls" not found
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207194    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207220    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9320bd7-3a62-499a-a12b-0ea85ca89dba-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.207266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207242    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktdgt\" (UniqueName: \"kubernetes.io/projected/a9320bd7-3a62-499a-a12b-0ea85ca89dba-kube-api-access-ktdgt\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207289    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207318    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207350    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-stats-auth\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207372    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207413    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq5r\" (UniqueName: \"kubernetes.io/projected/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-kube-api-access-bzq5r\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207458    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207488    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207518    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.207598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207545    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.208150 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207749    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9320bd7-3a62-499a-a12b-0ea85ca89dba-config\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.208150 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207884    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.208150 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.207912    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.208150 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.208000    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 02:19:16.208150 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.208066    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:16.708047098 +0000 UTC m=+269.992902344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : secret "router-metrics-certs-default" not found
Jul 07 02:19:16.208388 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.208278    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:16.708259247 +0000 UTC m=+269.993114486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : configmap references non-existent config key: service-ca.crt
Jul 07 02:19:16.209096 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.209072    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.210013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.209991    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9320bd7-3a62-499a-a12b-0ea85ca89dba-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.210403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.210379    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-default-certificate\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.210460 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.210401    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-stats-auth\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.210737 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.210722    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.210799 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.210778    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.215557 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.215533    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktdgt\" (UniqueName: \"kubernetes.io/projected/a9320bd7-3a62-499a-a12b-0ea85ca89dba-kube-api-access-ktdgt\") pod \"service-ca-operator-5d46d9ffd4-pcs6s\" (UID: \"a9320bd7-3a62-499a-a12b-0ea85ca89dba\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.215727 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.215708    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq5r\" (UniqueName: \"kubernetes.io/projected/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-kube-api-access-bzq5r\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.216258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.216235    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9xr5\" (UniqueName: \"kubernetes.io/projected/c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3-kube-api-access-t9xr5\") pod \"network-check-source-989f8b8dc-zgtv7\" (UID: \"c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"
Jul 07 02:19:16.216604 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.216582    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.216698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.216680    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzh8\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.230647 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.230618    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8"
Jul 07 02:19:16.235324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.235304    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"
Jul 07 02:19:16.322510 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.322478    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"
Jul 07 02:19:16.330664 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.330635    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"
Jul 07 02:19:16.371560 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.371496    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9"]
Jul 07 02:19:16.375249 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:16.375195    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe98e6e_062b_456d_8f26_7636c1597043.slice/crio-f72704d881f8025543ef19f61d9ff0f76ef7943a566b6cdcb7a7b311e9200fb1 WatchSource:0}: Error finding container f72704d881f8025543ef19f61d9ff0f76ef7943a566b6cdcb7a7b311e9200fb1: Status 404 returned error can't find the container with id f72704d881f8025543ef19f61d9ff0f76ef7943a566b6cdcb7a7b311e9200fb1
Jul 07 02:19:16.384771 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.384696    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-x9lf8"]
Jul 07 02:19:16.391505 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:16.391451    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef91ec5_453d_4036_8326_53ba11b6d928.slice/crio-e378c5285a7140eaaf0017b737b80e6b03c678f565b06b8974fd7f73c5863cdf WatchSource:0}: Error finding container e378c5285a7140eaaf0017b737b80e6b03c678f565b06b8974fd7f73c5863cdf: Status 404 returned error can't find the container with id e378c5285a7140eaaf0017b737b80e6b03c678f565b06b8974fd7f73c5863cdf
Jul 07 02:19:16.475370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.475287    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7"]
Jul 07 02:19:16.478604 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:16.478577    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d2c15c_d4cf_4fbb_b450_7a44b260e3b3.slice/crio-6bea0df03fb1ffbd8fcd1a9f5d4ce55da62cff20341ba3e365a2017c7635716f WatchSource:0}: Error finding container 6bea0df03fb1ffbd8fcd1a9f5d4ce55da62cff20341ba3e365a2017c7635716f: Status 404 returned error can't find the container with id 6bea0df03fb1ffbd8fcd1a9f5d4ce55da62cff20341ba3e365a2017c7635716f
Jul 07 02:19:16.494817 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.494790    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s"]
Jul 07 02:19:16.510010 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:16.509979    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9320bd7_3a62_499a_a12b_0ea85ca89dba.slice/crio-032d5906be6d12adf0a7f5ab8e567743a1ef1006f7c5c22d890627c16fe343a0 WatchSource:0}: Error finding container 032d5906be6d12adf0a7f5ab8e567743a1ef1006f7c5c22d890627c16fe343a0: Status 404 returned error can't find the container with id 032d5906be6d12adf0a7f5ab8e567743a1ef1006f7c5c22d890627c16fe343a0
Jul 07 02:19:16.711519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.711478    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.711541    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:16.711579    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711661    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711685    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd57f98cd-8xkjp: secret "image-registry-tls" not found
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711685    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711701    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:17.711688128 +0000 UTC m=+270.996543368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : configmap references non-existent config key: service-ca.crt
Jul 07 02:19:16.711742 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711734    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls podName:23064df1-5fa7-45ea-85d6-7d720bf2950e nodeName:}" failed. No retries permitted until 2026-07-07 02:19:17.711718118 +0000 UTC m=+270.996573359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls") pod "image-registry-6fd57f98cd-8xkjp" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e") : secret "image-registry-tls" not found
Jul 07 02:19:16.712060 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:16.711752    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:17.711742818 +0000 UTC m=+270.996598058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : secret "router-metrics-certs-default" not found
Jul 07 02:19:17.080860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.080788    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s" event={"ID":"a9320bd7-3a62-499a-a12b-0ea85ca89dba","Type":"ContainerStarted","Data":"032d5906be6d12adf0a7f5ab8e567743a1ef1006f7c5c22d890627c16fe343a0"}
Jul 07 02:19:17.085808 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.085369    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7" event={"ID":"c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3","Type":"ContainerStarted","Data":"c5ecc6a78bbf906e9de68626a3dfcbaa2265f7eacab05795b4bb3d3c8a46f297"}
Jul 07 02:19:17.085808 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.085426    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7" event={"ID":"c0d2c15c-d4cf-4fbb-b450-7a44b260e3b3","Type":"ContainerStarted","Data":"6bea0df03fb1ffbd8fcd1a9f5d4ce55da62cff20341ba3e365a2017c7635716f"}
Jul 07 02:19:17.087642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.087609    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9" event={"ID":"ebe98e6e-062b-456d-8f26-7636c1597043","Type":"ContainerStarted","Data":"f72704d881f8025543ef19f61d9ff0f76ef7943a566b6cdcb7a7b311e9200fb1"}
Jul 07 02:19:17.089406 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.089377    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8" event={"ID":"bef91ec5-453d-4036-8326-53ba11b6d928","Type":"ContainerStarted","Data":"e378c5285a7140eaaf0017b737b80e6b03c678f565b06b8974fd7f73c5863cdf"}
Jul 07 02:19:17.101975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.101900    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zgtv7" podStartSLOduration=2.101878205 podStartE2EDuration="2.101878205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:17.100772014 +0000 UTC m=+270.385627277" watchObservedRunningTime="2026-07-07 02:19:17.101878205 +0000 UTC m=+270.386733471"
Jul 07 02:19:17.723062 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.723013    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:17.723270 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.723070    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:17.723270 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:17.723143    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:17.723270 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723203    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 02:19:17.723270 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723239    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:19:17.723270 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723249    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd57f98cd-8xkjp: secret "image-registry-tls" not found
Jul 07 02:19:17.723535 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723430    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:19.723263739 +0000 UTC m=+273.008118993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : secret "router-metrics-certs-default" not found
Jul 07 02:19:17.723535 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723487    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:19.72347717 +0000 UTC m=+273.008332412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : configmap references non-existent config key: service-ca.crt
Jul 07 02:19:17.723660 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:17.723556    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls podName:23064df1-5fa7-45ea-85d6-7d720bf2950e nodeName:}" failed. No retries permitted until 2026-07-07 02:19:19.723546646 +0000 UTC m=+273.008401886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls") pod "image-registry-6fd57f98cd-8xkjp" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e") : secret "image-registry-tls" not found
Jul 07 02:19:19.740301 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:19.740261    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:19.740773 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:19.740328    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:19.740773 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:19.740346    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:19.740773 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740471    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.740457796 +0000 UTC m=+277.025313035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : configmap references non-existent config key: service-ca.crt
Jul 07 02:19:19.740949 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740808    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:19:19.740949 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740820    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd57f98cd-8xkjp: secret "image-registry-tls" not found
Jul 07 02:19:19.740949 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740852    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls podName:23064df1-5fa7-45ea-85d6-7d720bf2950e nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.740842113 +0000 UTC m=+277.025697352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls") pod "image-registry-6fd57f98cd-8xkjp" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e") : secret "image-registry-tls" not found
Jul 07 02:19:19.740949 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740892    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 02:19:19.740949 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:19.740912    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.740905158 +0000 UTC m=+277.025760396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : secret "router-metrics-certs-default" not found
Jul 07 02:19:20.102513 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.102471    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9" event={"ID":"ebe98e6e-062b-456d-8f26-7636c1597043","Type":"ContainerStarted","Data":"3b60cb9d9ddec3d7166eb935393f2ba91ced80ce6db63a12cb9212662736242c"}
Jul 07 02:19:20.104179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.104126    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8" event={"ID":"bef91ec5-453d-4036-8326-53ba11b6d928","Type":"ContainerStarted","Data":"f47b7d275ada86b39b23b1a94b1f6a3419f64256b909335cf746688ffe3f3d80"}
Jul 07 02:19:20.105609 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.105580    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s" event={"ID":"a9320bd7-3a62-499a-a12b-0ea85ca89dba","Type":"ContainerStarted","Data":"dbe5350bed7d506a6151650bd5983c25742b6b762878665906a84d1fce84abde"}
Jul 07 02:19:20.117439 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.117394    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9" podStartSLOduration=1.903585359 podStartE2EDuration="5.117378846s" totalImagesPullingTime="3.213793487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:20.116537405 +0000 UTC m=+273.401392665" watchObservedRunningTime="2026-07-07 02:19:20.117378846 +0000 UTC m=+273.402234085"
Jul 07 02:19:20.131598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.130262    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s" podStartSLOduration=2.050574671 podStartE2EDuration="5.130236942s" totalImagesPullingTime="3.079662271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:20.130170593 +0000 UTC m=+273.415025855" watchObservedRunningTime="2026-07-07 02:19:20.130236942 +0000 UTC m=+273.415092203"
Jul 07 02:19:20.148229 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:20.148171    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8" podStartSLOduration=1.9573056850000001 podStartE2EDuration="5.1481506s" totalImagesPullingTime="3.190844915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:20.14685475 +0000 UTC m=+273.431710012" watchObservedRunningTime="2026-07-07 02:19:20.1481506 +0000 UTC m=+273.433005844"
Jul 07 02:19:21.538047 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.538003    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gn8ms"]
Jul 07 02:19:21.540860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.540843    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.543357 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.543334    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kcspv\""
Jul 07 02:19:21.543599 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.543584    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 02:19:21.545727 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.545712    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 02:19:21.600627 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.600589    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gn8ms"]
Jul 07 02:19:21.657398 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.657363    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.657572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.657417    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.657572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.657548    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vct62\" (UniqueName: \"kubernetes.io/projected/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-api-access-vct62\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.657643 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.657576    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63fa2bec-6fff-46f0-899a-c52dfba71026-crio-socket\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.657643 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.657602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63fa2bec-6fff-46f0-899a-c52dfba71026-data-volume\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.758981 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.758943    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759002    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759069    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vct62\" (UniqueName: \"kubernetes.io/projected/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-api-access-vct62\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759086    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63fa2bec-6fff-46f0-899a-c52dfba71026-crio-socket\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:21.759093    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759102    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63fa2bec-6fff-46f0-899a-c52dfba71026-data-volume\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759174 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:21.759160    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:21.759472 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:21.759166    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.259144976 +0000 UTC m=+275.544000220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:21.759472 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759221    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63fa2bec-6fff-46f0-899a-c52dfba71026-crio-socket\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.759472 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:21.759237    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.259220082 +0000 UTC m=+275.544075333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:21.759472 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.759393    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63fa2bec-6fff-46f0-899a-c52dfba71026-data-volume\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:21.772146 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:21.772118    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vct62\" (UniqueName: \"kubernetes.io/projected/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-api-access-vct62\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:22.263132 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:22.263089    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:22.263334 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:22.263151    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:22.263334 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:22.263226    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:22.263334 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:22.263245    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:22.263334 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:22.263279    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.263265601 +0000 UTC m=+276.548120841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:22.263334 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:22.263300    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.263286934 +0000 UTC m=+276.548142177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:23.272257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.272217    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:23.272655 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.272271    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:23.272655 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.272370    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:23.272655 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.272394    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:23.272655 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.272429    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.272414095 +0000 UTC m=+278.557269335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:23.272655 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.272444    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.272437274 +0000 UTC m=+278.557292512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:23.338880 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.338845    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4ljwz"]
Jul 07 02:19:23.341094 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.341076    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.343192 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.343172    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 02:19:23.343330 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.343228    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dcbhp\""
Jul 07 02:19:23.343717 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.343699    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 02:19:23.343797 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.343724    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 02:19:23.343856 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.343840    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 02:19:23.352012 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.351989    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4ljwz"]
Jul 07 02:19:23.474065 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.474028    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-cabundle\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.474244 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.474082    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-key\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.474244 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.474176    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgkn\" (UniqueName: \"kubernetes.io/projected/11ebacea-1a57-4856-a7fc-676c68a1e0d8-kube-api-access-hkgkn\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.574798 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.574760    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-key\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.574980 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.574836    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgkn\" (UniqueName: \"kubernetes.io/projected/11ebacea-1a57-4856-a7fc-676c68a1e0d8-kube-api-access-hkgkn\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.574980 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.574899    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-cabundle\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.575558 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.575540    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-cabundle\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.577312 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.577296    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11ebacea-1a57-4856-a7fc-676c68a1e0d8-signing-key\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.584263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.584240    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgkn\" (UniqueName: \"kubernetes.io/projected/11ebacea-1a57-4856-a7fc-676c68a1e0d8-kube-api-access-hkgkn\") pod \"service-ca-758f599c5-4ljwz\" (UID: \"11ebacea-1a57-4856-a7fc-676c68a1e0d8\") " pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.650520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.650485    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-4ljwz"
Jul 07 02:19:23.776629 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.776588    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.776667    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.776694    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776725    2545 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776745    2545 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd57f98cd-8xkjp: secret "image-registry-tls" not found
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776795    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 02:19:23.776821 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776809    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls podName:23064df1-5fa7-45ea-85d6-7d720bf2950e nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.77679162 +0000 UTC m=+285.061646877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls") pod "image-registry-6fd57f98cd-8xkjp" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e") : secret "image-registry-tls" not found
Jul 07 02:19:23.777068 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776831    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.776821963 +0000 UTC m=+285.061677207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : configmap references non-existent config key: service-ca.crt
Jul 07 02:19:23.777068 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:23.776846    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs podName:e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.776838195 +0000 UTC m=+285.061693435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs") pod "router-default-688bb557ff-hjz8t" (UID: "e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514") : secret "router-metrics-certs-default" not found
Jul 07 02:19:23.780807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:23.780778    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4ljwz"]
Jul 07 02:19:23.783858 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:23.783821    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ebacea_1a57_4856_a7fc_676c68a1e0d8.slice/crio-bcc338123549a16e0c3baf8b23487961fdbd4b18ab56927b75f74c7c4229836a WatchSource:0}: Error finding container bcc338123549a16e0c3baf8b23487961fdbd4b18ab56927b75f74c7c4229836a: Status 404 returned error can't find the container with id bcc338123549a16e0c3baf8b23487961fdbd4b18ab56927b75f74c7c4229836a
Jul 07 02:19:24.119573 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:24.119485    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-4ljwz" event={"ID":"11ebacea-1a57-4856-a7fc-676c68a1e0d8","Type":"ContainerStarted","Data":"08ef223d94810fa4a3040dc4fb91b324a80f2ef29e922b2bbd9627aa66187e08"}
Jul 07 02:19:24.119573 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:24.119542    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-4ljwz" event={"ID":"11ebacea-1a57-4856-a7fc-676c68a1e0d8","Type":"ContainerStarted","Data":"bcc338123549a16e0c3baf8b23487961fdbd4b18ab56927b75f74c7c4229836a"}
Jul 07 02:19:24.139626 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:24.139570    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-4ljwz" podStartSLOduration=1.139554448 podStartE2EDuration="1.139554448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:24.138090139 +0000 UTC m=+277.422945401" watchObservedRunningTime="2026-07-07 02:19:24.139554448 +0000 UTC m=+277.424409752"
Jul 07 02:19:24.302828 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:24.302799    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxxz7_2b72273f-bfd0-4091-86fe-aa32631c8311/dns-node-resolver/0.log"
Jul 07 02:19:25.288729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:25.288685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:25.288965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:25.288896    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:25.289064 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:25.289044    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:25.289307 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:25.289282    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.289247391 +0000 UTC m=+282.574102641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:25.289307 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:25.289293    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:25.289444 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:25.289347    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.289330212 +0000 UTC m=+282.574185455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:25.302535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:25.302511    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdzq5_523c938d-deb8-4c9c-b68f-af401372c576/node-ca/0.log"
Jul 07 02:19:25.903972 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:25.903905    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b6gst_7b643258-d8d2-47db-9d4f-a9500678120f/serve-healthcheck-canary/0.log"
Jul 07 02:19:26.902582 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:26.902541    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-95gh9_ebe98e6e-062b-456d-8f26-7636c1597043/kube-storage-version-migrator-operator/0.log"
Jul 07 02:19:29.324628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:29.324587    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:29.325140 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:29.324655    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:29.325140 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:29.324750    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:29.325140 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:29.324807    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:29.325140 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:29.324817    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.32480198 +0000 UTC m=+290.609657220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:29.325140 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:29.324888    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm podName:63fa2bec-6fff-46f0-899a-c52dfba71026 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.324873669 +0000 UTC m=+290.609728912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn8ms" (UID: "63fa2bec-6fff-46f0-899a-c52dfba71026") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:30.827240 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:30.827186    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nhqvq" podUID="0aef31f0-20ee-4f9c-853f-5998579dc0c6"
Jul 07 02:19:31.143549 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.143467    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:31.847295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.847249    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:31.847295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.847295    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:31.847720 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.847536    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:31.848054 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.847993    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-service-ca-bundle\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:31.849934 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.849902    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"image-registry-6fd57f98cd-8xkjp\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") " pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:31.850025 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.850001    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514-metrics-certs\") pod \"router-default-688bb557ff-hjz8t\" (UID: \"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514\") " pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:31.940398 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.940362    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:31.945090 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:31.945068    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:32.085569 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:32.085491    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-688bb557ff-hjz8t"]
Jul 07 02:19:32.090984 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:32.090952    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35fb5e8_0b47_4f50_ad1e_5b5fea3f8514.slice/crio-1a6d605fefc5e7352829bdb6dc696005519380963d07c8bb082b2baa206fe222 WatchSource:0}: Error finding container 1a6d605fefc5e7352829bdb6dc696005519380963d07c8bb082b2baa206fe222: Status 404 returned error can't find the container with id 1a6d605fefc5e7352829bdb6dc696005519380963d07c8bb082b2baa206fe222
Jul 07 02:19:32.104764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:32.104688    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:19:32.108142 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:32.108117    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23064df1_5fa7_45ea_85d6_7d720bf2950e.slice/crio-fab8c2fa3234074365e1d92adcfb3528ec149785bd8af813d2f9705029f2e09c WatchSource:0}: Error finding container fab8c2fa3234074365e1d92adcfb3528ec149785bd8af813d2f9705029f2e09c: Status 404 returned error can't find the container with id fab8c2fa3234074365e1d92adcfb3528ec149785bd8af813d2f9705029f2e09c
Jul 07 02:19:32.149129 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:32.149059    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" event={"ID":"23064df1-5fa7-45ea-85d6-7d720bf2950e","Type":"ContainerStarted","Data":"fab8c2fa3234074365e1d92adcfb3528ec149785bd8af813d2f9705029f2e09c"}
Jul 07 02:19:32.150779 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:32.150706    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-688bb557ff-hjz8t" event={"ID":"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514","Type":"ContainerStarted","Data":"1a6d605fefc5e7352829bdb6dc696005519380963d07c8bb082b2baa206fe222"}
Jul 07 02:19:33.155800 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.155765    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" event={"ID":"23064df1-5fa7-45ea-85d6-7d720bf2950e","Type":"ContainerStarted","Data":"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"}
Jul 07 02:19:33.156324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.155905    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:33.157328 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.157301    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-688bb557ff-hjz8t" event={"ID":"e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514","Type":"ContainerStarted","Data":"bd4611ce44996be35448fb9ce3c987883cd383c6bf5dbe57380820d91cc4f749"}
Jul 07 02:19:33.175128 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.175073    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" podStartSLOduration=18.175056114 podStartE2EDuration="18.175056114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:33.174051112 +0000 UTC m=+286.458906373" watchObservedRunningTime="2026-07-07 02:19:33.175056114 +0000 UTC m=+286.459911353"
Jul 07 02:19:33.195185 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.195130    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-688bb557ff-hjz8t" podStartSLOduration=18.195111856 podStartE2EDuration="18.195111856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:33.194402407 +0000 UTC m=+286.479257671" watchObservedRunningTime="2026-07-07 02:19:33.195111856 +0000 UTC m=+286.479967117"
Jul 07 02:19:33.940623 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.940585    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:33.942959 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:33.942934    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:34.160465 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.160431    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:34.161708 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.161690    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-688bb557ff-hjz8t"
Jul 07 02:19:34.467307 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.467273    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:34.469860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.469825    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0aef31f0-20ee-4f9c-853f-5998579dc0c6-metrics-tls\") pod \"dns-default-nhqvq\" (UID: \"0aef31f0-20ee-4f9c-853f-5998579dc0c6\") " pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:34.746152 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.746073    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\""
Jul 07 02:19:34.754880 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.754829    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:34.885775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:34.885743    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nhqvq"]
Jul 07 02:19:34.889265 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:34.889238    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aef31f0_20ee_4f9c_853f_5998579dc0c6.slice/crio-8712c382253607dd2bc5438cedcf89fa08b8824f6e02c2e3bd7ed162e1b0672a WatchSource:0}: Error finding container 8712c382253607dd2bc5438cedcf89fa08b8824f6e02c2e3bd7ed162e1b0672a: Status 404 returned error can't find the container with id 8712c382253607dd2bc5438cedcf89fa08b8824f6e02c2e3bd7ed162e1b0672a
Jul 07 02:19:35.164009 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:35.163965    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhqvq" event={"ID":"0aef31f0-20ee-4f9c-853f-5998579dc0c6","Type":"ContainerStarted","Data":"8712c382253607dd2bc5438cedcf89fa08b8824f6e02c2e3bd7ed162e1b0672a"}
Jul 07 02:19:37.173001 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.172961    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhqvq" event={"ID":"0aef31f0-20ee-4f9c-853f-5998579dc0c6","Type":"ContainerStarted","Data":"55943d223f36bc2da49390194baa70c5d98aee325c56e6a37f2164dbbc65e232"}
Jul 07 02:19:37.173478 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.173018    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhqvq" event={"ID":"0aef31f0-20ee-4f9c-853f-5998579dc0c6","Type":"ContainerStarted","Data":"1fdf218399fbe4595883b859da900bd4fc25da7d5a96984ec81948ac8d3a8099"}
Jul 07 02:19:37.173478 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.173055    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:37.191815 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.191763    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nhqvq" podStartSLOduration=251.694779432 podStartE2EDuration="4m13.191745263s" totalImagesPullingTime="1.496965831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:37.190764215 +0000 UTC m=+290.475619477" watchObservedRunningTime="2026-07-07 02:19:37.191745263 +0000 UTC m=+290.476600524"
Jul 07 02:19:37.389008 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.388962    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:37.389201 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.389027    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:37.389600 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.389577    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63fa2bec-6fff-46f0-899a-c52dfba71026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:37.391459 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.391440    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63fa2bec-6fff-46f0-899a-c52dfba71026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn8ms\" (UID: \"63fa2bec-6fff-46f0-899a-c52dfba71026\") " pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:37.449699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.449611    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gn8ms"
Jul 07 02:19:37.598642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:37.598610    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gn8ms"]
Jul 07 02:19:37.601569 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:37.601537    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fa2bec_6fff_46f0_899a_c52dfba71026.slice/crio-50753a6e62327a059c1fed153c6e0b12acbfd1d8cafa4ac462cf088e7002a301 WatchSource:0}: Error finding container 50753a6e62327a059c1fed153c6e0b12acbfd1d8cafa4ac462cf088e7002a301: Status 404 returned error can't find the container with id 50753a6e62327a059c1fed153c6e0b12acbfd1d8cafa4ac462cf088e7002a301
Jul 07 02:19:38.181004 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:38.180959    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn8ms" event={"ID":"63fa2bec-6fff-46f0-899a-c52dfba71026","Type":"ContainerStarted","Data":"50753a6e62327a059c1fed153c6e0b12acbfd1d8cafa4ac462cf088e7002a301"}
Jul 07 02:19:42.197912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:42.197825    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn8ms" event={"ID":"63fa2bec-6fff-46f0-899a-c52dfba71026","Type":"ContainerStarted","Data":"71b4495cc2dde40e01e216172a7dae09a2b39be8c77b944e875d14184e73ffb3"}
Jul 07 02:19:42.197912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:42.197886    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn8ms" event={"ID":"63fa2bec-6fff-46f0-899a-c52dfba71026","Type":"ContainerStarted","Data":"231a9e6227e4c2707262698169d8c9a83f883fc19c7f7967e5fa9ec20e44c5ab"}
Jul 07 02:19:43.475567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:43.475529    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:19:45.212233 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:45.212201    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn8ms" event={"ID":"63fa2bec-6fff-46f0-899a-c52dfba71026","Type":"ContainerStarted","Data":"6e922f40b1aa54c35cac10c5ad89e7f4b9e2086f37fc03739ff417b0f59a5c73"}
Jul 07 02:19:45.230257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:45.230189    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gn8ms" podStartSLOduration=17.540639636999998 podStartE2EDuration="24.23016684s" totalImagesPullingTime="6.689527203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:19:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:45.228884837 +0000 UTC m=+298.513740098" watchObservedRunningTime="2026-07-07 02:19:45.23016684 +0000 UTC m=+298.515022102"
Jul 07 02:19:45.254369 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:19:45.254333    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7gmps" podUID="68d91463-8bf4-43e9-9489-b387548b79c9"
Jul 07 02:19:47.139079 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:47.138868    2545 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 02:19:47.182858 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:47.182829    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nhqvq"
Jul 07 02:19:50.709657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.709627    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"]
Jul 07 02:19:50.711829 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.711814    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:50.717513 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.717489    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 02:19:50.717673 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.717644    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fbpkj\""
Jul 07 02:19:50.722801 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.722775    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"]
Jul 07 02:19:50.791191 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.791145    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cef667f3-30b1-4df7-8205-163213fccee0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-k24tj\" (UID: \"cef667f3-30b1-4df7-8205-163213fccee0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:50.892069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.892037    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cef667f3-30b1-4df7-8205-163213fccee0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-k24tj\" (UID: \"cef667f3-30b1-4df7-8205-163213fccee0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:50.894497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:50.894474    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cef667f3-30b1-4df7-8205-163213fccee0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-k24tj\" (UID: \"cef667f3-30b1-4df7-8205-163213fccee0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:51.020845 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.020751    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:51.148003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.147975    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"]
Jul 07 02:19:51.151200 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:51.151173    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef667f3_30b1_4df7_8205_163213fccee0.slice/crio-901394f86388708aa5c3c5a6f2d720c0b4e9a17a997969c5404b0c05adff919e WatchSource:0}: Error finding container 901394f86388708aa5c3c5a6f2d720c0b4e9a17a997969c5404b0c05adff919e: Status 404 returned error can't find the container with id 901394f86388708aa5c3c5a6f2d720c0b4e9a17a997969c5404b0c05adff919e
Jul 07 02:19:51.153284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.153266    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:19:51.231789 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.231755    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj" event={"ID":"cef667f3-30b1-4df7-8205-163213fccee0","Type":"ContainerStarted","Data":"901394f86388708aa5c3c5a6f2d720c0b4e9a17a997969c5404b0c05adff919e"}
Jul 07 02:19:51.887045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.887010    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:19:51.888861 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.888846    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:51.890952 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.890897    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 02:19:51.891445 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891421    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6hjz\""
Jul 07 02:19:51.891445 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891435    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 02:19:51.891594 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891467    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 02:19:51.891594 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891478    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 02:19:51.891748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891730    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 02:19:51.891807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.891761    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 02:19:51.896387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.892547    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 02:19:51.901662 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:51.901641    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:19:52.000263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000220    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.000452 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000289    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.000452 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000396    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.000452 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000441    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.000626 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000464    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltft5\" (UniqueName: \"kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.000626 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.000540    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101036 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.100998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101068    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101090    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101105    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltft5\" (UniqueName: \"kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101138    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101162    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.101893 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101832    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.102018 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.101886    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.102286 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.102262    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.103947 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.103908    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.104051 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.103983    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.109804 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.109778    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltft5\" (UniqueName: \"kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5\") pod \"console-558867f648-4x5tz\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") " pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.200488 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.200372    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:19:52.400572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:52.400538    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:19:52.403518 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:19:52.403493    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0d0ef1_e66c_4158_9939_d7a4b787f74a.slice/crio-9c903af95ed66b2c9f1c5f9aa254ccd4dab7c746f41ad8a48c1161dd5f65d171 WatchSource:0}: Error finding container 9c903af95ed66b2c9f1c5f9aa254ccd4dab7c746f41ad8a48c1161dd5f65d171: Status 404 returned error can't find the container with id 9c903af95ed66b2c9f1c5f9aa254ccd4dab7c746f41ad8a48c1161dd5f65d171
Jul 07 02:19:53.241055 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.241019    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558867f648-4x5tz" event={"ID":"db0d0ef1-e66c-4158-9939-d7a4b787f74a","Type":"ContainerStarted","Data":"9c903af95ed66b2c9f1c5f9aa254ccd4dab7c746f41ad8a48c1161dd5f65d171"}
Jul 07 02:19:53.242661 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.242626    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj" event={"ID":"cef667f3-30b1-4df7-8205-163213fccee0","Type":"ContainerStarted","Data":"ef60d7cd60a5199252c733a3409190d2e60d9733b884765b365abedeff59187e"}
Jul 07 02:19:53.242885 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.242810    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:53.247997 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.247977    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj"
Jul 07 02:19:53.259012 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.258960    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-k24tj" podStartSLOduration=2.116628565 podStartE2EDuration="3.258941791s" totalImagesPullingTime="1.142313226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:53.258241059 +0000 UTC m=+306.543096321" watchObservedRunningTime="2026-07-07 02:19:53.258941791 +0000 UTC m=+306.543797043"
Jul 07 02:19:53.481355 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:53.481329    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:19:56.253143 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:56.253116    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:19:56.255347 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:56.255323    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558867f648-4x5tz" event={"ID":"db0d0ef1-e66c-4158-9939-d7a4b787f74a","Type":"ContainerStarted","Data":"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"}
Jul 07 02:19:56.270484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:19:56.270440    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558867f648-4x5tz" podStartSLOduration=2.093372432 podStartE2EDuration="5.270422718s" totalImagesPullingTime="3.177050286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:56.270293909 +0000 UTC m=+309.555149171" watchObservedRunningTime="2026-07-07 02:19:56.270422718 +0000 UTC m=+309.555277980"
Jul 07 02:20:02.201387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:02.201343    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:02.201783 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:02.201406    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:02.206327 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:02.206296    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:02.276022 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:02.275996    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:08.498185 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.498116    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" podUID="23064df1-5fa7-45ea-85d6-7d720bf2950e" containerName="registry" containerID="cri-o://52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594" gracePeriod=30
Jul 07 02:20:08.750287 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.750216    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:20:08.844472 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844432    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844478    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844521    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844552    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844578    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844612    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zzh8\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844952 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844661    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.844952 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.844692    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates\") pod \"23064df1-5fa7-45ea-85d6-7d720bf2950e\" (UID: \"23064df1-5fa7-45ea-85d6-7d720bf2950e\") "
Jul 07 02:20:08.845292 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.845259    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:08.845973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.845945    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:08.847254 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.847211    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:08.847557 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.847531    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:08.847731 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.847689    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8" (OuterVolumeSpecName: "kube-api-access-5zzh8") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "kube-api-access-5zzh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:08.848298 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.848258    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:08.848868 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.848844    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:08.856561 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.856525    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "23064df1-5fa7-45ea-85d6-7d720bf2950e" (UID: "23064df1-5fa7-45ea-85d6-7d720bf2950e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:20:08.945389 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945350    2545 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-certificates\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945389 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945378    2545 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-bound-sa-token\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945389 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945387    2545 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-installation-pull-secrets\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945389 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945397    2545 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23064df1-5fa7-45ea-85d6-7d720bf2950e-image-registry-private-configuration\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945407    2545 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23064df1-5fa7-45ea-85d6-7d720bf2950e-ca-trust-extracted\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945415    2545 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-registry-tls\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945423    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zzh8\" (UniqueName: \"kubernetes.io/projected/23064df1-5fa7-45ea-85d6-7d720bf2950e-kube-api-access-5zzh8\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:08.945653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:08.945432    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23064df1-5fa7-45ea-85d6-7d720bf2950e-trusted-ca\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:09.106608 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.106575    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"]
Jul 07 02:20:09.106994 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.106979    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23064df1-5fa7-45ea-85d6-7d720bf2950e" containerName="registry"
Jul 07 02:20:09.107045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.106997    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="23064df1-5fa7-45ea-85d6-7d720bf2950e" containerName="registry"
Jul 07 02:20:09.107080 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.107060    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="23064df1-5fa7-45ea-85d6-7d720bf2950e" containerName="registry"
Jul 07 02:20:09.110577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.110547    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.112818 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.112651    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 02:20:09.112818 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.112711    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 02:20:09.112818 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.112726    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-24lj9\""
Jul 07 02:20:09.113087 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.113027    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 02:20:09.113211 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.113176    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 02:20:09.113284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.113223    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 02:20:09.121965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.121907    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"]
Jul 07 02:20:09.123448 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.123426    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7dkr6"]
Jul 07 02:20:09.125818 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.125797    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.126399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.126377    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"]
Jul 07 02:20:09.128256 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.128078    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9dhbd\""
Jul 07 02:20:09.128367 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.128254    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 02:20:09.128998 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.128979    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 02:20:09.129315 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.129294    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.130116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.130099    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 02:20:09.133291 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.133174    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 02:20:09.133291 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.133191    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-58wcb\""
Jul 07 02:20:09.133291 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.133198    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 02:20:09.133589 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.133575    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 02:20:09.146641 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.146610    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"]
Jul 07 02:20:09.247839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.247805    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.247844    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.247899    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lsx\" (UniqueName: \"kubernetes.io/projected/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-kube-api-access-m2lsx\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.247951    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-tls\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.247967    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fctd\" (UniqueName: \"kubernetes.io/projected/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-kube-api-access-2fctd\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248019    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-sys\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248055    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248076    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-metrics-client-ca\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248109    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f256face-7ce4-4c80-9edf-2982029eb94c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248126    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248150    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-textfile\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248165    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248186    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248247    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g65f\" (UniqueName: \"kubernetes.io/projected/f256face-7ce4-4c80-9edf-2982029eb94c-kube-api-access-6g65f\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248285    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248312    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248334    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-root\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.248956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.248365    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-wtmp\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.296187 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.296155    2545 generic.go:356] "Generic (PLEG): container finished" podID="23064df1-5fa7-45ea-85d6-7d720bf2950e" containerID="52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594" exitCode=0
Jul 07 02:20:09.296378 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.296222    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" event={"ID":"23064df1-5fa7-45ea-85d6-7d720bf2950e","Type":"ContainerDied","Data":"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"}
Jul 07 02:20:09.296378 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.296254    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp"
Jul 07 02:20:09.296378 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.296284    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd57f98cd-8xkjp" event={"ID":"23064df1-5fa7-45ea-85d6-7d720bf2950e","Type":"ContainerDied","Data":"fab8c2fa3234074365e1d92adcfb3528ec149785bd8af813d2f9705029f2e09c"}
Jul 07 02:20:09.296378 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.296311    2545 scope.go:117] "RemoveContainer" containerID="52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"
Jul 07 02:20:09.304854 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.304835    2545 scope.go:117] "RemoveContainer" containerID="52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"
Jul 07 02:20:09.305196 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:09.305174    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594\": container with ID starting with 52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594 not found: ID does not exist" containerID="52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"
Jul 07 02:20:09.305257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.305207    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594"} err="failed to get container status \"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594\": rpc error: code = NotFound desc = could not find container \"52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594\": container with ID starting with 52fb2bcc669fe26278c661a98a810f2607ac5f59fe8be4173232e4fb7b6d3594 not found: ID does not exist"
Jul 07 02:20:09.310117 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.310095    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:20:09.313362 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.313342    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fd57f98cd-8xkjp"]
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349556    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349600    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-root\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349626    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-wtmp\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349688    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349720    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349744    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lsx\" (UniqueName: \"kubernetes.io/projected/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-kube-api-access-m2lsx\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349771    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-tls\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349794    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fctd\" (UniqueName: \"kubernetes.io/projected/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-kube-api-access-2fctd\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349824    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-sys\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349857    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349882    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-metrics-client-ca\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349908    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f256face-7ce4-4c80-9edf-2982029eb94c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349963    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350007    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-textfile\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350033    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.351369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350068    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350100    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350128    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g65f\" (UniqueName: \"kubernetes.io/projected/f256face-7ce4-4c80-9edf-2982029eb94c-kube-api-access-6g65f\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350168    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350500    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350647    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-wtmp\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.350703    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.351020    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f256face-7ce4-4c80-9edf-2982029eb94c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.352295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.351121    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-metrics-client-ca\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.352999    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-sys\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.353224    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.353250    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-textfile\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.349744    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-root\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:09.353322    2545 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 02:20:09.353492 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:09.353388    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls podName:f256face-7ce4-4c80-9edf-2982029eb94c nodeName:}" failed. No retries permitted until 2026-07-07 02:20:09.853369778 +0000 UTC m=+323.138225024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-5n926" (UID: "f256face-7ce4-4c80-9edf-2982029eb94c") : secret "kube-state-metrics-tls" not found
Jul 07 02:20:09.353961 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.353808    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.357335 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.357272    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.357335 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.357272    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.357807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.357766    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-tls\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.359316 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.359296    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.359583 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.359559    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.362087 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.361972    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fctd\" (UniqueName: \"kubernetes.io/projected/b6fa1daa-76f0-4e9a-af48-bfacfbee79ce-kube-api-access-2fctd\") pod \"node-exporter-7dkr6\" (UID: \"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce\") " pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.362485 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.362461    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g65f\" (UniqueName: \"kubernetes.io/projected/f256face-7ce4-4c80-9edf-2982029eb94c-kube-api-access-6g65f\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.362764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.362739    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lsx\" (UniqueName: \"kubernetes.io/projected/2d1a3717-77ca-47f8-8053-b7cd59ff6aef-kube-api-access-m2lsx\") pod \"openshift-state-metrics-54cf96dfcf-d2ncs\" (UID: \"2d1a3717-77ca-47f8-8053-b7cd59ff6aef\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.420914 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.420873    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"
Jul 07 02:20:09.438019 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.437991    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dkr6"
Jul 07 02:20:09.452111 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:20:09.452079    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6fa1daa_76f0_4e9a_af48_bfacfbee79ce.slice/crio-3b596ea0e1ac9df4f835375ce3aeec8a27efe1494a9e7bf2d16ef178c583dd88 WatchSource:0}: Error finding container 3b596ea0e1ac9df4f835375ce3aeec8a27efe1494a9e7bf2d16ef178c583dd88: Status 404 returned error can't find the container with id 3b596ea0e1ac9df4f835375ce3aeec8a27efe1494a9e7bf2d16ef178c583dd88
Jul 07 02:20:09.568683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.568653    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs"]
Jul 07 02:20:09.571595 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:20:09.571570    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1a3717_77ca_47f8_8053_b7cd59ff6aef.slice/crio-fd9c71ca4121125281caaabccd38c84de2d40039a4ebaf0e8923081cbfffe27c WatchSource:0}: Error finding container fd9c71ca4121125281caaabccd38c84de2d40039a4ebaf0e8923081cbfffe27c: Status 404 returned error can't find the container with id fd9c71ca4121125281caaabccd38c84de2d40039a4ebaf0e8923081cbfffe27c
Jul 07 02:20:09.855087 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.855046    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:09.857585 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:09.857558    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f256face-7ce4-4c80-9edf-2982029eb94c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-5n926\" (UID: \"f256face-7ce4-4c80-9edf-2982029eb94c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:10.045318 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.045280    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"
Jul 07 02:20:10.201022 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.200991    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:20:10.210805 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.210771    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.213048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.212785    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 02:20:10.213048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.212851    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 02:20:10.213048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.212818    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 02:20:10.213346 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213226    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 02:20:10.213346 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213260    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vkn2l\""
Jul 07 02:20:10.213346 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213309    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 02:20:10.213490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213262    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 02:20:10.213569 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213549    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 02:20:10.213637 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213557    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 02:20:10.213691 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.213557    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 02:20:10.221833 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.219030    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926"]
Jul 07 02:20:10.228820 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.228675    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:20:10.303261 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.303162    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926" event={"ID":"f256face-7ce4-4c80-9edf-2982029eb94c","Type":"ContainerStarted","Data":"f960b866258ae478a8b04a2293082faac52960ee8d4a2267409b243a3e7e013d"}
Jul 07 02:20:10.304711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.304646    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dkr6" event={"ID":"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce","Type":"ContainerStarted","Data":"3b596ea0e1ac9df4f835375ce3aeec8a27efe1494a9e7bf2d16ef178c583dd88"}
Jul 07 02:20:10.307270 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.307238    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs" event={"ID":"2d1a3717-77ca-47f8-8053-b7cd59ff6aef","Type":"ContainerStarted","Data":"a2a49e6e8b64ee4c109063595cd6275f620918c76f0731383ecb7d5bce1efbde"}
Jul 07 02:20:10.307403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.307309    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs" event={"ID":"2d1a3717-77ca-47f8-8053-b7cd59ff6aef","Type":"ContainerStarted","Data":"fdda9649ac723f0573a8130184bbc664ff88aa0ce0982f343744dfa9cf7fbd51"}
Jul 07 02:20:10.307403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.307339    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs" event={"ID":"2d1a3717-77ca-47f8-8053-b7cd59ff6aef","Type":"ContainerStarted","Data":"fd9c71ca4121125281caaabccd38c84de2d40039a4ebaf0e8923081cbfffe27c"}
Jul 07 02:20:10.360791 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360728    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360799    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360859    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360894    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360938    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkjrc\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360971    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361003 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.360991    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361029    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361098    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361124    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361144    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361162    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.361402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.361199    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462414 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462370    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462588 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462444    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462588 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462482    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462588 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462522    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462588 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462555    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjrc\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462588 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462585    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462611    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462646    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462676    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462712    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462736    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462759    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.462867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.462789    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.463220 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:10.463044    2545 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 07 02:20:10.463220 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:10.463116    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls podName:d46ad5e3-f4af-43b2-86a0-9abc0d8ed729 nodeName:}" failed. No retries permitted until 2026-07-07 02:20:10.963096071 +0000 UTC m=+324.247951323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729") : secret "alertmanager-main-tls" not found
Jul 07 02:20:10.464388 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.463380    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.464388 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.463397    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.464388 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.464208    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.466137 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.466092    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.466881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.466528    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.466881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.466860    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.467268 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.466969    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.467268 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.466975    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.467819 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.467785    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.468653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.468632    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.468984 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.468968    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.472026 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.471992    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkjrc\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.968148 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.968106    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:10.970744 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:10.970720    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:11.111907 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.111882    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-99c8f66bc-mrdns"]
Jul 07 02:20:11.126359 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.126331    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.127141 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.127112    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99c8f66bc-mrdns"]
Jul 07 02:20:11.128581 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.128543    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 02:20:11.128724 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.128700    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 02:20:11.129091 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.129072    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 02:20:11.129194 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.128878    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8jdll\""
Jul 07 02:20:11.130374 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.129339    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 02:20:11.130374 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.128819    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 02:20:11.130374 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.128947    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dtneoaub3in1i\""
Jul 07 02:20:11.132657 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.132626    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:20:11.261551 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.261208    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23064df1-5fa7-45ea-85d6-7d720bf2950e" path="/var/lib/kubelet/pods/23064df1-5fa7-45ea-85d6-7d720bf2950e/volumes"
Jul 07 02:20:11.272315 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272255    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272315 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272301    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272326    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272362    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f24f525-81db-4dfe-9b90-b03e5e718ea2-metrics-client-ca\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272447    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272504    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272524    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-grpc-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.272577 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.272543    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lfw\" (UniqueName: \"kubernetes.io/projected/2f24f525-81db-4dfe-9b90-b03e5e718ea2-kube-api-access-j5lfw\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.308109 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.308084    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:20:11.314046 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.314017    2545 generic.go:356] "Generic (PLEG): container finished" podID="b6fa1daa-76f0-4e9a-af48-bfacfbee79ce" containerID="7f2380ad478bded3a482854984e24dfe58a4ca6ee4a3ec3f954af702483f831a" exitCode=0
Jul 07 02:20:11.314178 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.314089    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dkr6" event={"ID":"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce","Type":"ContainerDied","Data":"7f2380ad478bded3a482854984e24dfe58a4ca6ee4a3ec3f954af702483f831a"}
Jul 07 02:20:11.316188 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.316165    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs" event={"ID":"2d1a3717-77ca-47f8-8053-b7cd59ff6aef","Type":"ContainerStarted","Data":"f40ede41b62ffe1c9e2aacd7d2f25a95ab26442e8e45385ee7157b772886cfe9"}
Jul 07 02:20:11.331829 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:20:11.331806    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46ad5e3_f4af_43b2_86a0_9abc0d8ed729.slice/crio-56fb9029f03dfbb77b09fb812039815f2b3662dfef81e2496f6ce82b32318426 WatchSource:0}: Error finding container 56fb9029f03dfbb77b09fb812039815f2b3662dfef81e2496f6ce82b32318426: Status 404 returned error can't find the container with id 56fb9029f03dfbb77b09fb812039815f2b3662dfef81e2496f6ce82b32318426
Jul 07 02:20:11.346295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.346247    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d2ncs" podStartSLOduration=1.008798135 podStartE2EDuration="2.346231416s" totalImagesPullingTime="1.337433281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:11.345510219 +0000 UTC m=+324.630365479" watchObservedRunningTime="2026-07-07 02:20:11.346231416 +0000 UTC m=+324.631086676"
Jul 07 02:20:11.373895 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.373868    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374034 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.373902    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-grpc-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374047    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lfw\" (UniqueName: \"kubernetes.io/projected/2f24f525-81db-4dfe-9b90-b03e5e718ea2-kube-api-access-j5lfw\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374163 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374145    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374212 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374184    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374210    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374310 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374267    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f24f525-81db-4dfe-9b90-b03e5e718ea2-metrics-client-ca\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.374310 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374301    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.375000 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.374978    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f24f525-81db-4dfe-9b90-b03e5e718ea2-metrics-client-ca\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377250 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377225    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377344    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-grpc-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377339    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377500 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377403    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377500 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377420    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.377747 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.377727    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2f24f525-81db-4dfe-9b90-b03e5e718ea2-secret-thanos-querier-tls\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.381124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.381104    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lfw\" (UniqueName: \"kubernetes.io/projected/2f24f525-81db-4dfe-9b90-b03e5e718ea2-kube-api-access-j5lfw\") pod \"thanos-querier-99c8f66bc-mrdns\" (UID: \"2f24f525-81db-4dfe-9b90-b03e5e718ea2\") " pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.438690 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.438662    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:11.618829 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:11.618785    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99c8f66bc-mrdns"]
Jul 07 02:20:11.624507 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:20:11.624470    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f24f525_81db_4dfe_9b90_b03e5e718ea2.slice/crio-e956b760bad925dc72aa717034f5acc7bf5cc67494790b1208769112a6ab85f6 WatchSource:0}: Error finding container e956b760bad925dc72aa717034f5acc7bf5cc67494790b1208769112a6ab85f6: Status 404 returned error can't find the container with id e956b760bad925dc72aa717034f5acc7bf5cc67494790b1208769112a6ab85f6
Jul 07 02:20:12.321522 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:12.321485    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"56fb9029f03dfbb77b09fb812039815f2b3662dfef81e2496f6ce82b32318426"}
Jul 07 02:20:12.323812 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:12.323790    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dkr6" event={"ID":"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce","Type":"ContainerStarted","Data":"5fb977e714216e5dbdff65f2a42609cbfd086b6db2f4250fa7107f4c3abdeba5"}
Jul 07 02:20:12.323963 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:12.323832    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dkr6" event={"ID":"b6fa1daa-76f0-4e9a-af48-bfacfbee79ce","Type":"ContainerStarted","Data":"f82871cbd0f00ce4cb7bb51003f00fb2f42b682e510a6a7a1956e96ef9480d0b"}
Jul 07 02:20:12.325181 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:12.325161    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"e956b760bad925dc72aa717034f5acc7bf5cc67494790b1208769112a6ab85f6"}
Jul 07 02:20:12.341576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:12.341523    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7dkr6" podStartSLOduration=1.623459781 podStartE2EDuration="3.34150352s" totalImagesPullingTime="1.582203077s" totalInitContainerRuntime="135.840662ms" isStatefulPod=true podCreationTimestamp="2026-07-07 02:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:12.340464205 +0000 UTC m=+325.625319467" watchObservedRunningTime="2026-07-07 02:20:12.34150352 +0000 UTC m=+325.626358821"
Jul 07 02:20:13.330741 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.330705    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704" exitCode=0
Jul 07 02:20:13.331204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.330794    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704"}
Jul 07 02:20:13.333228 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.333206    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926" event={"ID":"f256face-7ce4-4c80-9edf-2982029eb94c","Type":"ContainerStarted","Data":"5423aa07792b178f1f1a0425c9b7c132d4aa43097c91b915c4c871cd3f2be2a8"}
Jul 07 02:20:13.333341 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.333272    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926" event={"ID":"f256face-7ce4-4c80-9edf-2982029eb94c","Type":"ContainerStarted","Data":"f32ae802d1727c8675fc4c5a6dfe51c1f2664e986e703a558d8f1d356540220f"}
Jul 07 02:20:13.333341 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.333306    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926" event={"ID":"f256face-7ce4-4c80-9edf-2982029eb94c","Type":"ContainerStarted","Data":"cab7efa7b4ad77dda604c872fe9d5c2227d0d97860929c5c2c709c7e71dce389"}
Jul 07 02:20:13.368820 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:13.368769    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-5n926" podStartSLOduration=2.185005193 podStartE2EDuration="4.368751736s" totalImagesPullingTime="2.183746543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:13.367985164 +0000 UTC m=+326.652840424" watchObservedRunningTime="2026-07-07 02:20:13.368751736 +0000 UTC m=+326.653606996"
Jul 07 02:20:14.345997 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:14.345950    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"59b724cd1bbe2f8b055d909c67c8d2f6112af12535530629562dbe31f284f460"}
Jul 07 02:20:14.346485 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:14.346084    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"25292c26cbd031677650fc1d8afed42b5619590c7e03a983aadc31dfd1d429ef"}
Jul 07 02:20:14.346485 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:14.346129    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"637c2b679dc2504421bfd876a29b60d94d1607a55510437d232311124dc450fd"}
Jul 07 02:20:15.518873 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.518845    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:20:15.524357 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.524290    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.526715 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.526688    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 02:20:15.527521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.527502    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 02:20:15.527850 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.527828    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 02:20:15.528081 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528062    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 02:20:15.528154 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528092    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 02:20:15.528210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528185    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 02:20:15.528283 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528266    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 02:20:15.528333 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528309    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 02:20:15.528489 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528472    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 02:20:15.528663 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528647    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9mmq\""
Jul 07 02:20:15.528739 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528717    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 02:20:15.528864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528849    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 02:20:15.528979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528948    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 02:20:15.528979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.528970    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9lk83u5m3kt5c\""
Jul 07 02:20:15.529116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.529054    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 02:20:15.533699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.533661    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 02:20:15.534633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.534505    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 02:20:15.542091 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.542070    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:20:15.617177 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617146    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617186    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617236    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617316    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mlm\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617390    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617419    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617446    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617490    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617523    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617559    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617595    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617669    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617696    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617715    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617731    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617752    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617797    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617839    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.617882 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.617878    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719133 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719109    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719223 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719157    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719223 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719180    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719223 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719197    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719223 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719218    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719245    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719282    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719305    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719325    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mlm\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719346    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719365    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719382    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719409    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719430    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719453    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719490    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719546    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719574    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719596    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.719733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.719622    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.720225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.720160    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.720936 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.720885    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.721698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.721342    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.722404 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.722294    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.723564 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.723356    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.723665 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.723567    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.726799 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.726384    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.726799 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.726762    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.727381 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.727183    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.727381 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.727235    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.727381 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.727363    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.727582 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.727514    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.727800    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728010    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728134    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728230    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728346    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728459    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.728729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.728711    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.739077 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.739058    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mlm\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm\") pod \"prometheus-k8s-0\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.836392 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.836294    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:15.987666 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:15.987637    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:20:15.990979 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:20:15.990952    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc4fee5_3b71_4927_a246_f6b124846f80.slice/crio-cc3a4ca5403be5ff7202e322a91dd0cf8f0b14b7a2f5c9cdfa3d996ab0f6dd89 WatchSource:0}: Error finding container cc3a4ca5403be5ff7202e322a91dd0cf8f0b14b7a2f5c9cdfa3d996ab0f6dd89: Status 404 returned error can't find the container with id cc3a4ca5403be5ff7202e322a91dd0cf8f0b14b7a2f5c9cdfa3d996ab0f6dd89
Jul 07 02:20:16.357156 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357068    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"}
Jul 07 02:20:16.357156 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357149    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"}
Jul 07 02:20:16.357366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357189    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"}
Jul 07 02:20:16.357366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357223    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"}
Jul 07 02:20:16.357366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357257    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"}
Jul 07 02:20:16.357366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.357293    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerStarted","Data":"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"}
Jul 07 02:20:16.358565 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.358541    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584" exitCode=0
Jul 07 02:20:16.358676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.358614    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"}
Jul 07 02:20:16.358676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.358669    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"cc3a4ca5403be5ff7202e322a91dd0cf8f0b14b7a2f5c9cdfa3d996ab0f6dd89"}
Jul 07 02:20:16.361711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.361623    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"340ffb45c127fa42369ab6632c85b202aebfa7f6c73961853e620dd81b7dbf57"}
Jul 07 02:20:16.361711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.361672    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"900b04e64f6fd87c5ebfb6874211e139f4359663b48a53c91127597488f5450b"}
Jul 07 02:20:16.361711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.361697    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" event={"ID":"2f24f525-81db-4dfe-9b90-b03e5e718ea2","Type":"ContainerStarted","Data":"3c266a6a199eba1433a0408cc536ccec253b3413bae5dd5f94f0997b899a76bc"}
Jul 07 02:20:16.361848 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.361811    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:16.383758 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.383707    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.576370051 podStartE2EDuration="6.383690983s" totalImagesPullingTime="3.79217433s" totalInitContainerRuntime="15.146602ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:16.383290182 +0000 UTC m=+329.668145440" watchObservedRunningTime="2026-07-07 02:20:16.383690983 +0000 UTC m=+329.668546242"
Jul 07 02:20:16.404782 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:16.404713    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns" podStartSLOduration=1.930464814 podStartE2EDuration="5.404691609s" totalImagesPullingTime="3.474226795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:16.404402494 +0000 UTC m=+329.689257756" watchObservedRunningTime="2026-07-07 02:20:16.404691609 +0000 UTC m=+329.689546873"
Jul 07 02:20:20.385515 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385481    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"}
Jul 07 02:20:20.385889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385545    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"}
Jul 07 02:20:20.385889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385575    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"}
Jul 07 02:20:20.385889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385599    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"}
Jul 07 02:20:20.385889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385621    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"}
Jul 07 02:20:20.385889 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.385643    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerStarted","Data":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"}
Jul 07 02:20:20.413838 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.413729    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.048266427 podStartE2EDuration="5.413707662s" totalImagesPullingTime="3.348896772s" totalInitContainerRuntime="16.544463ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:20.411989467 +0000 UTC m=+333.696844729" watchObservedRunningTime="2026-07-07 02:20:20.413707662 +0000 UTC m=+333.698562924"
Jul 07 02:20:20.837256 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:20.837220    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:20:22.374300 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:22.374271    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-99c8f66bc-mrdns"
Jul 07 02:20:30.430043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:30.429996    2545 generic.go:356] "Generic (PLEG): container finished" podID="a9320bd7-3a62-499a-a12b-0ea85ca89dba" containerID="dbe5350bed7d506a6151650bd5983c25742b6b762878665906a84d1fce84abde" exitCode=0
Jul 07 02:20:30.430516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:30.430169    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s" event={"ID":"a9320bd7-3a62-499a-a12b-0ea85ca89dba","Type":"ContainerDied","Data":"dbe5350bed7d506a6151650bd5983c25742b6b762878665906a84d1fce84abde"}
Jul 07 02:20:30.430641 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:30.430621    2545 scope.go:117] "RemoveContainer" containerID="dbe5350bed7d506a6151650bd5983c25742b6b762878665906a84d1fce84abde"
Jul 07 02:20:31.436499 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:31.436464    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-pcs6s" event={"ID":"a9320bd7-3a62-499a-a12b-0ea85ca89dba","Type":"ContainerStarted","Data":"fba71cf6736db73f15ba766faab0091f724665b13c432ddb08fbe403e461ff3c"}
Jul 07 02:20:32.189053 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:32.189019    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:20:35.454998 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:35.454967    2545 generic.go:356] "Generic (PLEG): container finished" podID="ebe98e6e-062b-456d-8f26-7636c1597043" containerID="3b60cb9d9ddec3d7166eb935393f2ba91ced80ce6db63a12cb9212662736242c" exitCode=0
Jul 07 02:20:35.455414 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:35.455009    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9" event={"ID":"ebe98e6e-062b-456d-8f26-7636c1597043","Type":"ContainerDied","Data":"3b60cb9d9ddec3d7166eb935393f2ba91ced80ce6db63a12cb9212662736242c"}
Jul 07 02:20:35.455414 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:35.455347    2545 scope.go:117] "RemoveContainer" containerID="3b60cb9d9ddec3d7166eb935393f2ba91ced80ce6db63a12cb9212662736242c"
Jul 07 02:20:36.461023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:36.460982    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-95gh9" event={"ID":"ebe98e6e-062b-456d-8f26-7636c1597043","Type":"ContainerStarted","Data":"63c1d1599ad312c9c6d280c5b2070f8351877eef8c40b57f7e0e74050bac108d"}
Jul 07 02:20:46.501976 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:46.501910    2545 generic.go:356] "Generic (PLEG): container finished" podID="bef91ec5-453d-4036-8326-53ba11b6d928" containerID="f47b7d275ada86b39b23b1a94b1f6a3419f64256b909335cf746688ffe3f3d80" exitCode=0
Jul 07 02:20:46.502359 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:46.501986    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8" event={"ID":"bef91ec5-453d-4036-8326-53ba11b6d928","Type":"ContainerDied","Data":"f47b7d275ada86b39b23b1a94b1f6a3419f64256b909335cf746688ffe3f3d80"}
Jul 07 02:20:46.502418 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:46.502404    2545 scope.go:117] "RemoveContainer" containerID="f47b7d275ada86b39b23b1a94b1f6a3419f64256b909335cf746688ffe3f3d80"
Jul 07 02:20:47.512835 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:47.512162    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-x9lf8" event={"ID":"bef91ec5-453d-4036-8326-53ba11b6d928","Type":"ContainerStarted","Data":"5970bc076080d7539be2e434194423d4dc8c5c670abe9f606a85c30065c34b0a"}
Jul 07 02:20:57.213054 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.212985    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-558867f648-4x5tz" podUID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" containerName="console" containerID="cri-o://bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae" gracePeriod=15
Jul 07 02:20:57.459775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.459743    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:57.554528 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.554499    2545 generic.go:356] "Generic (PLEG): container finished" podID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" containerID="bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae" exitCode=0
Jul 07 02:20:57.554739 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.554554    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558867f648-4x5tz"
Jul 07 02:20:57.554739 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.554590    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558867f648-4x5tz" event={"ID":"db0d0ef1-e66c-4158-9939-d7a4b787f74a","Type":"ContainerDied","Data":"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"}
Jul 07 02:20:57.554739 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.554643    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558867f648-4x5tz" event={"ID":"db0d0ef1-e66c-4158-9939-d7a4b787f74a","Type":"ContainerDied","Data":"9c903af95ed66b2c9f1c5f9aa254ccd4dab7c746f41ad8a48c1161dd5f65d171"}
Jul 07 02:20:57.554739 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.554664    2545 scope.go:117] "RemoveContainer" containerID="bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"
Jul 07 02:20:57.563554 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.563539    2545 scope.go:117] "RemoveContainer" containerID="bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"
Jul 07 02:20:57.563840 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:20:57.563821    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae\": container with ID starting with bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae not found: ID does not exist" containerID="bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"
Jul 07 02:20:57.563898 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.563863    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae"} err="failed to get container status \"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae\": rpc error: code = NotFound desc = could not find container \"bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae\": container with ID starting with bb15b177764a99d018881e39d718234aaa1ad5b1154ee45935729cb1e1a9f4ae not found: ID does not exist"
Jul 07 02:20:57.622240 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622207    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltft5\" (UniqueName: \"kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622416 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622255    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622416 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622308    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622416 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622345    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622455    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622507    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert\") pod \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\" (UID: \"db0d0ef1-e66c-4158-9939-d7a4b787f74a\") "
Jul 07 02:20:57.622754 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622726    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config" (OuterVolumeSpecName: "console-config") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:57.622867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622753    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:57.622867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622804    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca" (OuterVolumeSpecName: "service-ca") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:57.622867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622862    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-oauth-serving-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.623017 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622873    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-service-ca\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.623017 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.622885    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.624777 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.624754    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:57.625052 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.625032    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:57.625111 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.625059    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5" (OuterVolumeSpecName: "kube-api-access-ltft5") pod "db0d0ef1-e66c-4158-9939-d7a4b787f74a" (UID: "db0d0ef1-e66c-4158-9939-d7a4b787f74a"). InnerVolumeSpecName "kube-api-access-ltft5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:57.723740 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.723707    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-serving-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.723740 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.723735    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltft5\" (UniqueName: \"kubernetes.io/projected/db0d0ef1-e66c-4158-9939-d7a4b787f74a-kube-api-access-ltft5\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.723740 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.723745    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db0d0ef1-e66c-4158-9939-d7a4b787f74a-console-oauth-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:20:57.874051 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.874021    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:20:57.880307 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:57.880281    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558867f648-4x5tz"]
Jul 07 02:20:59.258202 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:20:59.258161    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" path="/var/lib/kubelet/pods/db0d0ef1-e66c-4158-9939-d7a4b787f74a/volumes"
Jul 07 02:21:01.054115 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.054064    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:21:01.056486 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.056464    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d91463-8bf4-43e9-9489-b387548b79c9-metrics-certs\") pod \"network-metrics-daemon-7gmps\" (UID: \"68d91463-8bf4-43e9-9489-b387548b79c9\") " pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:21:01.356506 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.356423    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\""
Jul 07 02:21:01.364980 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.364960    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gmps"
Jul 07 02:21:01.494854 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.494833    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gmps"]
Jul 07 02:21:01.497524 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:21:01.497493    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d91463_8bf4_43e9_9489_b387548b79c9.slice/crio-ad647570a21d4185102da236250c90dfafa0149e967c29d9bb1bdfc0f6910b22 WatchSource:0}: Error finding container ad647570a21d4185102da236250c90dfafa0149e967c29d9bb1bdfc0f6910b22: Status 404 returned error can't find the container with id ad647570a21d4185102da236250c90dfafa0149e967c29d9bb1bdfc0f6910b22
Jul 07 02:21:01.574816 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:01.574713    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gmps" event={"ID":"68d91463-8bf4-43e9-9489-b387548b79c9","Type":"ContainerStarted","Data":"ad647570a21d4185102da236250c90dfafa0149e967c29d9bb1bdfc0f6910b22"}
Jul 07 02:21:02.580652 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:02.580615    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gmps" event={"ID":"68d91463-8bf4-43e9-9489-b387548b79c9","Type":"ContainerStarted","Data":"c96190d4b638133709da843973d36ebf9732f4665bd64c381f2bfa94148c0763"}
Jul 07 02:21:02.581072 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:02.580669    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gmps" event={"ID":"68d91463-8bf4-43e9-9489-b387548b79c9","Type":"ContainerStarted","Data":"09f4925f63ac09b807807e1bf30e2b2ceb580a7d515353b2b7629184a187bbee"}
Jul 07 02:21:02.597593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:02.597540    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7gmps" podStartSLOduration=373.814035715 podStartE2EDuration="6m14.597522904s" totalImagesPullingTime="783.487189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:02.596387103 +0000 UTC m=+375.881242364" watchObservedRunningTime="2026-07-07 02:21:02.597522904 +0000 UTC m=+375.882378173"
Jul 07 02:21:15.836635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:15.836596    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:15.853565 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:15.853537    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:16.654797 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:16.654770    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:29.625518 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.625486    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:29.626061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.625867    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="alertmanager" containerID="cri-o://41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2" gracePeriod=120
Jul 07 02:21:29.626061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.625955    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-metric" containerID="cri-o://297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41" gracePeriod=120
Jul 07 02:21:29.626197 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.626098    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="prom-label-proxy" containerID="cri-o://118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3" gracePeriod=120
Jul 07 02:21:29.626197 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.625984    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-web" containerID="cri-o://33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623" gracePeriod=120
Jul 07 02:21:29.626197 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.626110    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy" containerID="cri-o://2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b" gracePeriod=120
Jul 07 02:21:29.626197 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:29.626059    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="config-reloader" containerID="cri-o://cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040" gracePeriod=120
Jul 07 02:21:30.699501 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699471    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3" exitCode=0
Jul 07 02:21:30.699501 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699495    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41" exitCode=0
Jul 07 02:21:30.699501 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699503    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b" exitCode=0
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699510    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040" exitCode=0
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699518    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2" exitCode=0
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699541    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"}
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699609    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"}
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699635    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"}
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699662    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"}
Jul 07 02:21:30.699968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.699685    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"}
Jul 07 02:21:30.885991 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:30.885966    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.014811 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.014719    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkjrc\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.014811 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.014760    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.014811 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.014794    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.014814    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.014962    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015030    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015065    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015113    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015150    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015185    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015223    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015253    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015268    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:31.015303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015298    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca\") pod \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\" (UID: \"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729\") "
Jul 07 02:21:31.015814 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.015747    2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.016376 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.016140    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:31.018328 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018127    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc" (OuterVolumeSpecName: "kube-api-access-qkjrc") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "kube-api-access-qkjrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:21:31.018435 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018420    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume" (OuterVolumeSpecName: "config-volume") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.018512 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018430    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out" (OuterVolumeSpecName: "config-out") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:21:31.018512 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018443    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:21:31.018726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018686    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.018726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018710    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.018726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.018721    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:21:31.020954 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.020911    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.021150 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.021126    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.023274 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.023246    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.029845 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.029817    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config" (OuterVolumeSpecName: "web-config") pod "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" (UID: "d46ad5e3-f4af-43b2-86a0-9abc0d8ed729"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:31.116535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116495    2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-tls-assets\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116534    2545 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-cluster-tls-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116535 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116543    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-metrics-client-ca\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116554    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkjrc\" (UniqueName: \"kubernetes.io/projected/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-kube-api-access-qkjrc\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116563    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116572    2545 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-volume\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116579    2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-web-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116586    2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-config-out\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116594    2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-alertmanager-main-db\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116602    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116610    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-main-tls\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.116772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.116620    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:31.707741 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.707711    2545 generic.go:356] "Generic (PLEG): container finished" podID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerID="33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623" exitCode=0
Jul 07 02:21:31.708193 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.707783    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"}
Jul 07 02:21:31.708193 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.707794    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.708193 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.707860    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d46ad5e3-f4af-43b2-86a0-9abc0d8ed729","Type":"ContainerDied","Data":"56fb9029f03dfbb77b09fb812039815f2b3662dfef81e2496f6ce82b32318426"}
Jul 07 02:21:31.708193 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.707894    2545 scope.go:117] "RemoveContainer" containerID="118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"
Jul 07 02:21:31.716646 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.716615    2545 scope.go:117] "RemoveContainer" containerID="297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"
Jul 07 02:21:31.729540 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.729514    2545 scope.go:117] "RemoveContainer" containerID="2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"
Jul 07 02:21:31.729881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.729861    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:31.734118 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.734099    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:31.737746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.737731    2545 scope.go:117] "RemoveContainer" containerID="33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"
Jul 07 02:21:31.745204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.745107    2545 scope.go:117] "RemoveContainer" containerID="cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"
Jul 07 02:21:31.753071 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.753042    2545 scope.go:117] "RemoveContainer" containerID="41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"
Jul 07 02:21:31.762780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.762754    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:31.763127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763098    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="prom-label-proxy"
Jul 07 02:21:31.763127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763112    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="prom-label-proxy"
Jul 07 02:21:31.763127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763123    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-metric"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763129    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-metric"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763137    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763142    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763149    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="alertmanager"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763153    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="alertmanager"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763162    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" containerName="console"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763170    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" containerName="console"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763180    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="config-reloader"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763186    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="config-reloader"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763201    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-web"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763206    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-web"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763214    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="init-config-reloader"
Jul 07 02:21:31.763225 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763219    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="init-config-reloader"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763228    2545 scope.go:117] "RemoveContainer" containerID="b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763310    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0d0ef1-e66c-4158-9939-d7a4b787f74a" containerName="console"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763325    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-web"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763365    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy-metric"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763374    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="kube-rbac-proxy"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763406    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="prom-label-proxy"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763417    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="alertmanager"
Jul 07 02:21:31.763730 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.763425    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" containerName="config-reloader"
Jul 07 02:21:31.769200 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.769176    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.771304 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771278    2545 scope.go:117] "RemoveContainer" containerID="118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"
Jul 07 02:21:31.771446 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771426    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 02:21:31.771518 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771431    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 02:21:31.771518 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771429    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 02:21:31.771620 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.771571    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3\": container with ID starting with 118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3 not found: ID does not exist" containerID="118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"
Jul 07 02:21:31.771620 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771592    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 02:21:31.771726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771606    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3"} err="failed to get container status \"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3\": rpc error: code = NotFound desc = could not find container \"118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3\": container with ID starting with 118a074ec87a29a2bd01c0835a8eb8275ad9b7d3a9c1cbc503097fa8e04087f3 not found: ID does not exist"
Jul 07 02:21:31.771726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771632    2545 scope.go:117] "RemoveContainer" containerID="297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"
Jul 07 02:21:31.771726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771655    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 02:21:31.771726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771680    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 02:21:31.771726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771725    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vkn2l\""
Jul 07 02:21:31.772016 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771777    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 02:21:31.772016 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.771884    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41\": container with ID starting with 297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41 not found: ID does not exist" containerID="297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"
Jul 07 02:21:31.772016 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771913    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41"} err="failed to get container status \"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41\": rpc error: code = NotFound desc = could not find container \"297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41\": container with ID starting with 297be0491d47c517e2b54b728b90a617206620ae83012cd6d1d9d28e1c34cf41 not found: ID does not exist"
Jul 07 02:21:31.772016 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.771957    2545 scope.go:117] "RemoveContainer" containerID="2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"
Jul 07 02:21:31.772016 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772013    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 02:21:31.772270 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.772247    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b\": container with ID starting with 2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b not found: ID does not exist" containerID="2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"
Jul 07 02:21:31.772328 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772277    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b"} err="failed to get container status \"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b\": rpc error: code = NotFound desc = could not find container \"2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b\": container with ID starting with 2ddee7834e3f95e481b7e4d77c928de4bc1b72b4a2f853d88b9cc025447a896b not found: ID does not exist"
Jul 07 02:21:31.772328 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772298    2545 scope.go:117] "RemoveContainer" containerID="33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"
Jul 07 02:21:31.772583 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.772561    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623\": container with ID starting with 33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623 not found: ID does not exist" containerID="33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"
Jul 07 02:21:31.772691 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772585    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623"} err="failed to get container status \"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623\": rpc error: code = NotFound desc = could not find container \"33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623\": container with ID starting with 33041a1fcf8f7755e2ddded20bce4b2668739a92f0707bd21a481c9e51ef9623 not found: ID does not exist"
Jul 07 02:21:31.772691 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772601    2545 scope.go:117] "RemoveContainer" containerID="cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"
Jul 07 02:21:31.772852 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.772828    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040\": container with ID starting with cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040 not found: ID does not exist" containerID="cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"
Jul 07 02:21:31.772908 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772859    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040"} err="failed to get container status \"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040\": rpc error: code = NotFound desc = could not find container \"cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040\": container with ID starting with cf3dc6dcb7535c9dd60f0be1d1d3a3ebfa993918fdefe9c7a234200f1a18a040 not found: ID does not exist"
Jul 07 02:21:31.772908 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.772878    2545 scope.go:117] "RemoveContainer" containerID="41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"
Jul 07 02:21:31.773243 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.773219    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2\": container with ID starting with 41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2 not found: ID does not exist" containerID="41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"
Jul 07 02:21:31.773355 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.773249    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2"} err="failed to get container status \"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2\": rpc error: code = NotFound desc = could not find container \"41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2\": container with ID starting with 41e8200e64436dc786ad26c7479ea9fea281e2c1644a471fe05804780d78b4e2 not found: ID does not exist"
Jul 07 02:21:31.773355 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.773269    2545 scope.go:117] "RemoveContainer" containerID="b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704"
Jul 07 02:21:31.773598 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:31.773578    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704\": container with ID starting with b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704 not found: ID does not exist" containerID="b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704"
Jul 07 02:21:31.773692 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.773613    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704"} err="failed to get container status \"b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704\": rpc error: code = NotFound desc = could not find container \"b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704\": container with ID starting with b3b1dd02fea68fd7d676c82f4a6977df0895538cd8ee8b1c958e3a14a5270704 not found: ID does not exist"
Jul 07 02:21:31.776527 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.776509    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 02:21:31.779343 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.779319    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:31.923210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923172    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923209    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923232    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-web-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923257    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923278    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923307    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923346    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923387    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923409    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq7mb\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-kube-api-access-vq7mb\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923427    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923688 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923447    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923688 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923470    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:31.923688 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:31.923488    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-out\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024169 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024075    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024169 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024110    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024169 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024133    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024169 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024153    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq7mb\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-kube-api-access-vq7mb\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024178    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024207    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024247    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024272    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-out\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024322    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024346    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024367    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-web-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024399    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.024490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.025013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.024905    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.025385 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.025128    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.025656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.025638    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.027424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.027395    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.027573 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.027536    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.027880 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.027855    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-config-out\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.028021 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.028000    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.028146 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.028129    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.028248 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.028219    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.028906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.028886    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.029062 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.029045    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.029115 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.029047    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-web-config\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.032534 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.032509    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq7mb\" (UniqueName: \"kubernetes.io/projected/ee5edcac-88a3-4ccb-bd84-01c5d361f3e9-kube-api-access-vq7mb\") pod \"alertmanager-main-0\" (UID: \"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.079869 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.079826    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 02:21:32.226642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.226605    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 02:21:32.229631 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:21:32.229604    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5edcac_88a3_4ccb_bd84_01c5d361f3e9.slice/crio-4c67ffce46bdb34661877549a62d17f7c9a8b126040cb29d2873c202bc1de9ca WatchSource:0}: Error finding container 4c67ffce46bdb34661877549a62d17f7c9a8b126040cb29d2873c202bc1de9ca: Status 404 returned error can't find the container with id 4c67ffce46bdb34661877549a62d17f7c9a8b126040cb29d2873c202bc1de9ca
Jul 07 02:21:32.713118 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.713085    2545 generic.go:356] "Generic (PLEG): container finished" podID="ee5edcac-88a3-4ccb-bd84-01c5d361f3e9" containerID="7e4a48209fe10b0e17c623f90e7c8dc27ceee3281f17d7dfe9db89fd5f272e21" exitCode=0
Jul 07 02:21:32.713561 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.713178    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerDied","Data":"7e4a48209fe10b0e17c623f90e7c8dc27ceee3281f17d7dfe9db89fd5f272e21"}
Jul 07 02:21:32.713561 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:32.713271    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"4c67ffce46bdb34661877549a62d17f7c9a8b126040cb29d2873c202bc1de9ca"}
Jul 07 02:21:33.259690 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.259603    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d46ad5e3-f4af-43b2-86a0-9abc0d8ed729" path="/var/lib/kubelet/pods/d46ad5e3-f4af-43b2-86a0-9abc0d8ed729/volumes"
Jul 07 02:21:33.722534 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722499    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"c2866845ed7a8d5504ff170b8515ed694b0ab4481f54b879ab3c5607c993d371"}
Jul 07 02:21:33.722903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722566    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"63e0db23b1647cabda9e15528d3cae9e4aa02201a622ab0af465b9be666df251"}
Jul 07 02:21:33.722903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722592    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"332852b654cb8a930fbabdb85eda4b9193722c10ef739665c34ecaecc222a030"}
Jul 07 02:21:33.722903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722618    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"04c98c3007651b59f751cc02000cc86fd10733515a3f2a42560cbb06eab5d38f"}
Jul 07 02:21:33.722903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722639    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"c361eebcc8ae0c0c3e58d3dbc6df96c8effb50f8e1a21aadbbc1dc30dcf2046b"}
Jul 07 02:21:33.722903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.722663    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee5edcac-88a3-4ccb-bd84-01c5d361f3e9","Type":"ContainerStarted","Data":"6876e00503ff86fbdaf65798bb5d6f14eb905ab88dcbb07da7b06e8ee25c0e11"}
Jul 07 02:21:33.747458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.747394    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.732876888 podStartE2EDuration="2.747375976s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.499088ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:33.7450469 +0000 UTC m=+407.029902161" watchObservedRunningTime="2026-07-07 02:21:33.747375976 +0000 UTC m=+407.032231237"
Jul 07 02:21:33.873659 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873627    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:33.873955 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873905    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="prometheus" containerID="cri-o://496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940" gracePeriod=600
Jul 07 02:21:33.874124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873948    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="thanos-sidecar" containerID="cri-o://b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f" gracePeriod=600
Jul 07 02:21:33.874124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873961    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-web" containerID="cri-o://3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915" gracePeriod=600
Jul 07 02:21:33.874124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873975    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78" gracePeriod=600
Jul 07 02:21:33.874124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873992    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="config-reloader" containerID="cri-o://9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689" gracePeriod=600
Jul 07 02:21:33.874124 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:33.873959    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy" containerID="cri-o://28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82" gracePeriod=600
Jul 07 02:21:34.117203 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.117174    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.245624 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245525    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245624 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245575    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245624 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245600    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245624 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245627    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245647    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245698    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4mlm\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245724    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.245988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245748    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246214 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.245978    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.246214 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246176    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246318 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246224    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246318 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246253    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246300    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246410    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246459    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246489    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246514    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246557    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246874 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246634    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246874 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246659    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246874 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246708    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8dc4fee5-3b71-4927-a246-f6b124846f80\" (UID: \"8dc4fee5-3b71-4927-a246-f6b124846f80\") "
Jul 07 02:21:34.246874 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.246790    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.247102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.247034    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.247102 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.247052    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.248483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.247327    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.248483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.247808    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.248483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.247971    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.248483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.248449    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.248795 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.248558    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:21:34.248886 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.248858    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.249122 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.248882    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:21:34.249666 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.249640    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm" (OuterVolumeSpecName: "kube-api-access-f4mlm") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "kube-api-access-f4mlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:21:34.249772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.249696    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:21:34.250160 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.250123    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config" (OuterVolumeSpecName: "config") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.250413 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.250387    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.250851 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.250822    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.251114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.251090    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out" (OuterVolumeSpecName: "config-out") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:21:34.251213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.251136    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.251276 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.251210    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.251654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.251623    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.251721 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.251667    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.261112 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.261085    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config" (OuterVolumeSpecName: "web-config") pod "8dc4fee5-3b71-4927-a246-f6b124846f80" (UID: "8dc4fee5-3b71-4927-a246-f6b124846f80"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:34.347675 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347642    2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-tls-assets\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347675 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347673    2545 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-metrics-client-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347684    2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-web-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347697    2545 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-config\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347710    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4mlm\" (UniqueName: \"kubernetes.io/projected/8dc4fee5-3b71-4927-a246-f6b124846f80-kube-api-access-f4mlm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347724    2545 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347734    2545 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-kube-rbac-proxy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347742    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347752    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-db\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347761    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347772    2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dc4fee5-3b71-4927-a246-f6b124846f80-config-out\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347782    2545 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-grpc-tls\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347790    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347797    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-metrics-client-ca\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347806    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347814    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347822    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8dc4fee5-3b71-4927-a246-f6b124846f80-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.347862 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.347830    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dc4fee5-3b71-4927-a246-f6b124846f80-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731117    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78" exitCode=0
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731141    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82" exitCode=0
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731146    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915" exitCode=0
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731152    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f" exitCode=0
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731157    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689" exitCode=0
Jul 07 02:21:34.731151 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731162    2545 generic.go:356] "Generic (PLEG): container finished" podID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940" exitCode=0
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731189    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731210    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731310    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731354    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731372    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731391    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731433    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731476    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"}
Jul 07 02:21:34.731864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.731516    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dc4fee5-3b71-4927-a246-f6b124846f80","Type":"ContainerDied","Data":"cc3a4ca5403be5ff7202e322a91dd0cf8f0b14b7a2f5c9cdfa3d996ab0f6dd89"}
Jul 07 02:21:34.741261 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.741238    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.749669 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.749652    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.754047 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.754018    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:34.758195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.758167    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:34.758611 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.758597    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.766475 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.766456    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.774161 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.774141    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.784818 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.784792    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:34.785140 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785124    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="init-config-reloader"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785144    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="init-config-reloader"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785159    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-web"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785165    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-web"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785171    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-thanos"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785177    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-thanos"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785185    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="prometheus"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785191    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="prometheus"
Jul 07 02:21:34.785195 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785197    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="thanos-sidecar"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785203    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="thanos-sidecar"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785220    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="config-reloader"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785225    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="config-reloader"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785234    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785237    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785241    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785396    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="prometheus"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785407    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-web"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785418    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="thanos-sidecar"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785426    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="config-reloader"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785436    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy-thanos"
Jul 07 02:21:34.785484 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.785443    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" containerName="kube-rbac-proxy"
Jul 07 02:21:34.789069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.789049    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.790983 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.790964    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 02:21:34.791138 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791120    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9lk83u5m3kt5c\""
Jul 07 02:21:34.791379 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791364    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 02:21:34.791693 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791545    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 02:21:34.791693 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791597    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 02:21:34.791693 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791639    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 02:21:34.791693 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791545    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 02:21:34.791987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791715    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 02:21:34.791987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791910    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9mmq\""
Jul 07 02:21:34.791987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.791943    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 02:21:34.792136 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.792107    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 02:21:34.792203 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.792183    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 02:21:34.792350 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.792325    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 02:21:34.792567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.792554    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 02:21:34.792773 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.792734    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 02:21:34.794530 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.794505    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.794843 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.794823    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 02:21:34.794953 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.794851    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.794953 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.794880    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.795064 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.794956    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.795275 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.795258    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.795330 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795281    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.795330 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795296    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.795555 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.795537    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.795656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795558    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.795656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795578    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.795871 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.795830    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.795871 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795866    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.796017 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.795880    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.796203 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.796186    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.796244 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796207    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.796244 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796222    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.796458 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.796440    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.796505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796459    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.796505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796475    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.796717 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:21:34.796700    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.796761 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796721    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.796761 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796734    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.796992 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796971    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.796992 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.796991    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.797146 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797133    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 02:21:34.797206 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797186    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.797269 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797208    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.797451 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797427    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.797550 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797451    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.797724 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797701    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.797784 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797724    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.797958 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797940    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.797958 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.797958    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.798218 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798190    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.798289 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798221    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.798565 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798481    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.798565 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798525    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.798756 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798735    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.798756 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798757    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.798965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798944    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.798965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.798965    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.799212 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.799188    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.799258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.799248    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.799554 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.799534    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.799651 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.799555    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.800179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.800008    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.800179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.800039    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.800729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.800701    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.800729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.800728    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.801022 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801002    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.801114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801023    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.801310 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801271    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.801310 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801301    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.801584 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801564    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.801584 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801583    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.801830 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801812    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.801903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.801832    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.802116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802096    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.802116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802115    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.802311 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802295    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.802311 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802311    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.802423 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802387    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:34.802512 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802495    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.802512 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802511    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.802715 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802699    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.802715 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802715    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.802948 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802909    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.802948 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.802948    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.803162 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803141    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.803209 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803166    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.803383 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803367    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.803383 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803381    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.803618 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803592    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.803709 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803618    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.803875 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803856    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.803965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.803876    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.804127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804102    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.804127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804126    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.804397 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804342    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.804397 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804366    2545 scope.go:117] "RemoveContainer" containerID="cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"
Jul 07 02:21:34.804612 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804596    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78"} err="failed to get container status \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": rpc error: code = NotFound desc = could not find container \"cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78\": container with ID starting with cfe664d5d7b0fe4e9e5e5c014661c65b87d49ed9d8c7333235b4edc0a6afee78 not found: ID does not exist"
Jul 07 02:21:34.804612 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804612    2545 scope.go:117] "RemoveContainer" containerID="28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"
Jul 07 02:21:34.804788 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804771    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82"} err="failed to get container status \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": rpc error: code = NotFound desc = could not find container \"28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82\": container with ID starting with 28171e2e6c1e457a47a633a0310f2da540cb1e461cdcd9d23f1159fb9ae05b82 not found: ID does not exist"
Jul 07 02:21:34.804838 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.804792    2545 scope.go:117] "RemoveContainer" containerID="3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"
Jul 07 02:21:34.805040 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805020    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915"} err="failed to get container status \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": rpc error: code = NotFound desc = could not find container \"3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915\": container with ID starting with 3647ef72ff0b88b2961c8cd02177cf461e59214844b1f8a3b11d15f22fd9e915 not found: ID does not exist"
Jul 07 02:21:34.805040 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805039    2545 scope.go:117] "RemoveContainer" containerID="b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"
Jul 07 02:21:34.805277 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805253    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f"} err="failed to get container status \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": rpc error: code = NotFound desc = could not find container \"b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f\": container with ID starting with b3fe0a5f88565a437199b5f2f8c4c5ff0e9af285bb677e48fb95e36c309f388f not found: ID does not exist"
Jul 07 02:21:34.805343 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805278    2545 scope.go:117] "RemoveContainer" containerID="9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"
Jul 07 02:21:34.805521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805504    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689"} err="failed to get container status \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": rpc error: code = NotFound desc = could not find container \"9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689\": container with ID starting with 9b777568a16184ca5f38f94a7aaefce5f31ae7b1b5ff0b2adec268ce789de689 not found: ID does not exist"
Jul 07 02:21:34.805569 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805522    2545 scope.go:117] "RemoveContainer" containerID="496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"
Jul 07 02:21:34.805746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805726    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940"} err="failed to get container status \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": rpc error: code = NotFound desc = could not find container \"496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940\": container with ID starting with 496bbd90c9b5d3bf12ff572132f5825dab3dc2681477d471cac61b02729ee940 not found: ID does not exist"
Jul 07 02:21:34.805746 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805746    2545 scope.go:117] "RemoveContainer" containerID="75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"
Jul 07 02:21:34.805976 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.805959    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584"} err="failed to get container status \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": rpc error: code = NotFound desc = could not find container \"75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584\": container with ID starting with 75e8a9d5c19b5259c3f8aebb6637f612d48ae88d0a9751b8003c26ff6a739584 not found: ID does not exist"
Jul 07 02:21:34.852099 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852066    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852243 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852151    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852243 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852170    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852243 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852189    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852243 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852207    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852405 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852372    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852451 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852430    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852504 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852451    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852559 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852537    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852675 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852641    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852675 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852667    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852691    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852715    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852817 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852796    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852850 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852817    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852850 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852834    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dvs\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-kube-api-access-68dvs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.852967 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852945    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.853011 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.852980    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.853051 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.853007    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.953975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.953859    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.953975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.953894    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.953975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.953910    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.953975 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.953950    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.953989    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954014    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954038    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dvs\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-kube-api-access-68dvs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954062    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954085    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954103    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.954747 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954711    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955041 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.954910    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955133 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955047    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955133 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955114    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955145    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955181    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955212    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955252    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955306    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955334    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955379    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955405    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.955598 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.955475    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.956359 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.956326    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.957457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.957427    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.957555 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.957520    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.957661 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.957629    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.958821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.958197    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.958821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.958508    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.958821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.958529    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.958821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.958658    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.958821 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.958817    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.959143 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.959085    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.959143 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.959109    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42ed4b3-49fd-480a-b97c-220ee8f458dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.959362 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.959345    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.960336 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.960309    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.960503 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.960476    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.961045 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.961022    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e42ed4b3-49fd-480a-b97c-220ee8f458dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.961241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.961222    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e42ed4b3-49fd-480a-b97c-220ee8f458dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:34.961745 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:34.961717    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dvs\" (UniqueName: \"kubernetes.io/projected/e42ed4b3-49fd-480a-b97c-220ee8f458dc-kube-api-access-68dvs\") pod \"prometheus-k8s-0\" (UID: \"e42ed4b3-49fd-480a-b97c-220ee8f458dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:35.102399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.102357    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:21:35.250082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.250017    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 02:21:35.252578 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:21:35.252555    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42ed4b3_49fd_480a_b97c_220ee8f458dc.slice/crio-688d8bc0216e8a9d6c91c27c855c87321164871b92c39f055368ffe30921e328 WatchSource:0}: Error finding container 688d8bc0216e8a9d6c91c27c855c87321164871b92c39f055368ffe30921e328: Status 404 returned error can't find the container with id 688d8bc0216e8a9d6c91c27c855c87321164871b92c39f055368ffe30921e328
Jul 07 02:21:35.258711 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.258685    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc4fee5-3b71-4927-a246-f6b124846f80" path="/var/lib/kubelet/pods/8dc4fee5-3b71-4927-a246-f6b124846f80/volumes"
Jul 07 02:21:35.737061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.737024    2545 generic.go:356] "Generic (PLEG): container finished" podID="e42ed4b3-49fd-480a-b97c-220ee8f458dc" containerID="fa6aa833269f9b1558ebf29f4d8ffe5397c6332f53356390b64829322c09aa67" exitCode=0
Jul 07 02:21:35.737497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.737111    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerDied","Data":"fa6aa833269f9b1558ebf29f4d8ffe5397c6332f53356390b64829322c09aa67"}
Jul 07 02:21:35.737497 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:35.737232    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"688d8bc0216e8a9d6c91c27c855c87321164871b92c39f055368ffe30921e328"}
Jul 07 02:21:36.745935 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.745897    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"ce99c43f8809f0ab7b30d4a977881206e536be93f3698b675aa7f33bea1a7228"}
Jul 07 02:21:36.746299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.745975    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"1066b45acf1565771358b6126f3fd4f9cdb04af6ee20a16972be582df4364a6c"}
Jul 07 02:21:36.746299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.746000    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"7dce380f7262d41446ed85f1bf9db5c503ac62150ea6ac65312bc5303cc37a04"}
Jul 07 02:21:36.746299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.746026    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"77402d4b38f49c6e2d16771d80b7fe70a634a0a4cbeef6f0f1281d26ef9ba4b0"}
Jul 07 02:21:36.746299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.746050    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"67ca8e50480b144a02f2f254349514ad67f039b5a6a9e8029efc52e2425f747e"}
Jul 07 02:21:36.746299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.746072    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e42ed4b3-49fd-480a-b97c-220ee8f458dc","Type":"ContainerStarted","Data":"e9793c5c27d318c9502db0cf8bc7ac93879e4de1b9a991acc3db681cca3ffe58"}
Jul 07 02:21:36.773503 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:36.773435    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.754549862 podStartE2EDuration="2.773411605s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.861743ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:36.770946024 +0000 UTC m=+410.055801283" watchObservedRunningTime="2026-07-07 02:21:36.773411605 +0000 UTC m=+410.058266870"
Jul 07 02:21:40.102941 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:21:40.102870    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:22:35.103217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:22:35.103166    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:22:35.119956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:22:35.119903    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:22:36.006570 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:22:36.006545    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 02:23:31.294022 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.293990    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"]
Jul 07 02:23:31.297709 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.297681    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.299910 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.299885    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 02:23:31.299910 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.299899    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 02:23:31.300149 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.300105    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 02:23:31.300149 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.300109    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 02:23:31.300396 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.300381    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sj57n\""
Jul 07 02:23:31.317119 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.317085    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"]
Jul 07 02:23:31.479803 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.479764    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.480020 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.479832    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.480020 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.479854    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5tbh\" (UniqueName: \"kubernetes.io/projected/acaf9c23-89df-4cd9-966d-ef470d30cb06-kube-api-access-c5tbh\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.480020 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.479883    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.480020 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.480003    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581409 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581315    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581409 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581365    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581409 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581410    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581431    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5tbh\" (UniqueName: \"kubernetes.io/projected/acaf9c23-89df-4cd9-966d-ef470d30cb06-kube-api-access-c5tbh\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581451    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.581816 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.581788    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.584051 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.584023    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acaf9c23-89df-4cd9-966d-ef470d30cb06-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.584170 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.584154    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.584240 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.584222    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acaf9c23-89df-4cd9-966d-ef470d30cb06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.592504 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.592464    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5tbh\" (UniqueName: \"kubernetes.io/projected/acaf9c23-89df-4cd9-966d-ef470d30cb06-kube-api-access-c5tbh\") pod \"opendatahub-operator-controller-manager-778f769c96-4cmqg\" (UID: \"acaf9c23-89df-4cd9-966d-ef470d30cb06\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.609545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.609504    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:31.753014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:31.752981    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"]
Jul 07 02:23:31.756710 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:23:31.756680    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacaf9c23_89df_4cd9_966d_ef470d30cb06.slice/crio-bf3e0c5d5211d8b15bc5473205c42124e831fd0a614ddf2209943bfb03f70dff WatchSource:0}: Error finding container bf3e0c5d5211d8b15bc5473205c42124e831fd0a614ddf2209943bfb03f70dff: Status 404 returned error can't find the container with id bf3e0c5d5211d8b15bc5473205c42124e831fd0a614ddf2209943bfb03f70dff
Jul 07 02:23:32.228533 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:32.228499    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg" event={"ID":"acaf9c23-89df-4cd9-966d-ef470d30cb06","Type":"ContainerStarted","Data":"bf3e0c5d5211d8b15bc5473205c42124e831fd0a614ddf2209943bfb03f70dff"}
Jul 07 02:23:35.245173 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:35.245070    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg" event={"ID":"acaf9c23-89df-4cd9-966d-ef470d30cb06","Type":"ContainerStarted","Data":"b0d5bd43f5de3dbba5c71f3d5a1f98f547eeb9558ab69ded35c1d4d72f8637d7"}
Jul 07 02:23:36.251145 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:36.251053    2545 generic.go:356] "Generic (PLEG): container finished" podID="acaf9c23-89df-4cd9-966d-ef470d30cb06" containerID="b0d5bd43f5de3dbba5c71f3d5a1f98f547eeb9558ab69ded35c1d4d72f8637d7" exitCode=0
Jul 07 02:23:36.251145 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:36.251100    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg" event={"ID":"acaf9c23-89df-4cd9-966d-ef470d30cb06","Type":"ContainerDied","Data":"b0d5bd43f5de3dbba5c71f3d5a1f98f547eeb9558ab69ded35c1d4d72f8637d7"}
Jul 07 02:23:37.258968 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:37.258931    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg" event={"ID":"acaf9c23-89df-4cd9-966d-ef470d30cb06","Type":"ContainerStarted","Data":"d49f19a51c0833d70b357e4d23bb0ed20be9fb04a5b2c353e063a0002bd778d7"}
Jul 07 02:23:37.259336 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:37.258979    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:37.280974 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:37.280895    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg" podStartSLOduration=1.871230042 podStartE2EDuration="6.280875954s" totalImagesPullingTime="3.397106848s" totalInitContainerRuntime="1.012539064s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:37.280121442 +0000 UTC m=+530.564976702" watchObservedRunningTime="2026-07-07 02:23:37.280875954 +0000 UTC m=+530.565731217"
Jul 07 02:23:48.266667 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:48.266637    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-4cmqg"
Jul 07 02:23:55.931518 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.931483    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"]
Jul 07 02:23:55.941529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.941504    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:55.943898 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.943871    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 02:23:55.944059 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.944005    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b4j8p\""
Jul 07 02:23:55.945173 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.945153    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 02:23:55.953855 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:55.953824    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"]
Jul 07 02:23:56.005742 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.005706    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.005940 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.005779    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tmp\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.005940 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.005863    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgflg\" (UniqueName: \"kubernetes.io/projected/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-kube-api-access-fgflg\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.106281 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.106246    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tmp\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.106458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.106313    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgflg\" (UniqueName: \"kubernetes.io/projected/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-kube-api-access-fgflg\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.106458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.106356    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.106541 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:23:56.106482    2545 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 02:23:56.106578 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:23:56.106546    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs podName:9b60126f-ec33-4b54-b6c9-bc6c39f5b0df nodeName:}" failed. No retries permitted until 2026-07-07 02:23:56.606527204 +0000 UTC m=+549.891382456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs") pod "kube-auth-proxy-654bb68cf4-k9zl9" (UID: "9b60126f-ec33-4b54-b6c9-bc6c39f5b0df") : secret "kube-auth-proxy-tls" not found
Jul 07 02:23:56.108764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.108738    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tmp\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.115581 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.115553    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgflg\" (UniqueName: \"kubernetes.io/projected/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-kube-api-access-fgflg\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.612524 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.612483    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.615368 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.615330    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b60126f-ec33-4b54-b6c9-bc6c39f5b0df-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-k9zl9\" (UID: \"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:56.854543 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:56.854503    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"
Jul 07 02:23:57.004440 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.004319    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9"]
Jul 07 02:23:57.007151 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:23:57.007125    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b60126f_ec33_4b54_b6c9_bc6c39f5b0df.slice/crio-ad76bb7246210b8ea82efb581a22852cbc3c8d743753cc1b5cdfbb47fd75bb7d WatchSource:0}: Error finding container ad76bb7246210b8ea82efb581a22852cbc3c8d743753cc1b5cdfbb47fd75bb7d: Status 404 returned error can't find the container with id ad76bb7246210b8ea82efb581a22852cbc3c8d743753cc1b5cdfbb47fd75bb7d
Jul 07 02:23:57.361610 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.361565    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9" event={"ID":"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df","Type":"ContainerStarted","Data":"ad76bb7246210b8ea82efb581a22852cbc3c8d743753cc1b5cdfbb47fd75bb7d"}
Jul 07 02:23:57.896824 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.896785    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"]
Jul 07 02:23:57.899208 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.899192    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:57.902605 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.902579    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 02:23:57.903136 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.903119    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:23:57.903237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.903125    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 02:23:57.903237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.903142    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n7fnj\""
Jul 07 02:23:57.903237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.903125    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 02:23:57.903237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.903155    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 02:23:57.912035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:57.912006    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"]
Jul 07 02:23:58.024217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.024180    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.024217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.024223    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.024692 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.024267    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.024692 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.024359    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8t2\" (UniqueName: \"kubernetes.io/projected/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-kube-api-access-gn8t2\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.125806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.125769    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.125806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.125818    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.126113 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.125856    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.126113 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.125948    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8t2\" (UniqueName: \"kubernetes.io/projected/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-kube-api-access-gn8t2\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.126614 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.126585    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.135305 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.128914    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.136422 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.136389    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.136853 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.136837    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8t2\" (UniqueName: \"kubernetes.io/projected/260b1f2e-6bbc-4bd1-b202-b22df8d451b9-kube-api-access-gn8t2\") pod \"lws-controller-manager-7fb48ccbfc-2mvdz\" (UID: \"260b1f2e-6bbc-4bd1-b202-b22df8d451b9\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.209619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.209516    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:23:58.376186 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:58.376159    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"]
Jul 07 02:23:58.378281 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:23:58.378247    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260b1f2e_6bbc_4bd1_b202_b22df8d451b9.slice/crio-dbf6fdb0eb4c6977fb8a0a6614f8ed84ec5b9818b85a50f67f5da94022f7c6b3 WatchSource:0}: Error finding container dbf6fdb0eb4c6977fb8a0a6614f8ed84ec5b9818b85a50f67f5da94022f7c6b3: Status 404 returned error can't find the container with id dbf6fdb0eb4c6977fb8a0a6614f8ed84ec5b9818b85a50f67f5da94022f7c6b3
Jul 07 02:23:59.376087 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:23:59.376007    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz" event={"ID":"260b1f2e-6bbc-4bd1-b202-b22df8d451b9","Type":"ContainerStarted","Data":"dbf6fdb0eb4c6977fb8a0a6614f8ed84ec5b9818b85a50f67f5da94022f7c6b3"}
Jul 07 02:24:02.393064 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.393031    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9" event={"ID":"9b60126f-ec33-4b54-b6c9-bc6c39f5b0df","Type":"ContainerStarted","Data":"7b8ec3ef3d50b61229150478f014ae8d45ab58413a529376edc0975e31081e93"}
Jul 07 02:24:02.394682 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.394660    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz" event={"ID":"260b1f2e-6bbc-4bd1-b202-b22df8d451b9","Type":"ContainerStarted","Data":"a2d043d9572a031a6fb7d7902cd277ba79446aa6ff103531e110b3366b76e4a1"}
Jul 07 02:24:02.394795 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.394780    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:24:02.466629 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.466575    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-k9zl9" podStartSLOduration=3.165701474 podStartE2EDuration="7.466557873s" totalImagesPullingTime="4.300856399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:02.463677538 +0000 UTC m=+555.748532798" watchObservedRunningTime="2026-07-07 02:24:02.466557873 +0000 UTC m=+555.751413132"
Jul 07 02:24:02.525113 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.525050    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz" podStartSLOduration=2.56597418 podStartE2EDuration="5.525032766s" totalImagesPullingTime="2.959058586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:02.516667843 +0000 UTC m=+555.801523103" watchObservedRunningTime="2026-07-07 02:24:02.525032766 +0000 UTC m=+555.809888027"
Jul 07 02:24:02.856246 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.856211    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"]
Jul 07 02:24:02.858751 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.858732    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:02.864402 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.864372    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4fr46\""
Jul 07 02:24:02.864783 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.864761    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 02:24:02.890284 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.890236    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"]
Jul 07 02:24:02.894940 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.894887    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"]
Jul 07 02:24:02.898159 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.898131    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:02.901860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.901838    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 02:24:02.902162 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.902146    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6w5l4\""
Jul 07 02:24:02.916423 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.916389    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"]
Jul 07 02:24:02.973861 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.973828    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtx2\" (UniqueName: \"kubernetes.io/projected/23179b3a-5c94-448c-9610-186923ae148b-kube-api-access-nhtx2\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:02.974068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.973909    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs9s2\" (UniqueName: \"kubernetes.io/projected/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-kube-api-access-zs9s2\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:02.974068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.973987    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:02.974068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:02.974012    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.074720 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.074676    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtx2\" (UniqueName: \"kubernetes.io/projected/23179b3a-5c94-448c-9610-186923ae148b-kube-api-access-nhtx2\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.074912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.074819    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs9s2\" (UniqueName: \"kubernetes.io/projected/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-kube-api-access-zs9s2\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:03.074912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.074865    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:03.074912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.074901    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.075115 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:24:03.075073    2545 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 02:24:03.075171 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:24:03.075145    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert podName:23179b3a-5c94-448c-9610-186923ae148b nodeName:}" failed. No retries permitted until 2026-07-07 02:24:03.575124436 +0000 UTC m=+556.859979696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert") pod "llmisvc-controller-manager-777c6bd7d5-7ndd5" (UID: "23179b3a-5c94-448c-9610-186923ae148b") : secret "llmisvc-webhook-server-cert" not found
Jul 07 02:24:03.078142 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.078114    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:03.089120 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.089086    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs9s2\" (UniqueName: \"kubernetes.io/projected/f0a518e4-031d-4cfd-9919-59ba02b7e6a0-kube-api-access-zs9s2\") pod \"kserve-controller-manager-d6f4b65b8-dktrj\" (UID: \"f0a518e4-031d-4cfd-9919-59ba02b7e6a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:03.099176 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.099147    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtx2\" (UniqueName: \"kubernetes.io/projected/23179b3a-5c94-448c-9610-186923ae148b-kube-api-access-nhtx2\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.171869 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.171767    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:03.330409 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.330375    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"]
Jul 07 02:24:03.332949 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:24:03.332902    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a518e4_031d_4cfd_9919_59ba02b7e6a0.slice/crio-c5b85a72ad43da6d83750b568c5b885bba243a250a395f08d10b5a3422c566e5 WatchSource:0}: Error finding container c5b85a72ad43da6d83750b568c5b885bba243a250a395f08d10b5a3422c566e5: Status 404 returned error can't find the container with id c5b85a72ad43da6d83750b568c5b885bba243a250a395f08d10b5a3422c566e5
Jul 07 02:24:03.401090 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.401049    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj" event={"ID":"f0a518e4-031d-4cfd-9919-59ba02b7e6a0","Type":"ContainerStarted","Data":"c5b85a72ad43da6d83750b568c5b885bba243a250a395f08d10b5a3422c566e5"}
Jul 07 02:24:03.580663 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.579963    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.584087 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.584001    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23179b3a-5c94-448c-9610-186923ae148b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7ndd5\" (UID: \"23179b3a-5c94-448c-9610-186923ae148b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.611890 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.611838    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"]
Jul 07 02:24:03.615696 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.615672    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.618601 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.618574    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b7ff5\""
Jul 07 02:24:03.619075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.619052    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 02:24:03.630101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.630075    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"]
Jul 07 02:24:03.681105 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681067    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681111    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681139    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681221    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681258    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681322 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681282    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681372    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqb9\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-kube-api-access-hmqb9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681436    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.681567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.681496    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782473 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782480    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782507    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782554    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782585    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782610    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782637    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqb9\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-kube-api-access-hmqb9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782990 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.782990 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.782747    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.783279 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.783251    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.783387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.783300    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.783387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.783342    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.783695 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.783650    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.784267 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.784236    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.786014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.785984    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.786370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.786347    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.792363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.792333    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.792694 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.792665    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqb9\" (UniqueName: \"kubernetes.io/projected/4a2509d8-c00e-4b99-befc-f7dee1b6b5d5-kube-api-access-hmqb9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47gfqr\" (UID: \"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:03.820956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.820883    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:03.930549 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:03.930516    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:04.017965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:04.017887    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"]
Jul 07 02:24:04.018472 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:24:04.018442    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23179b3a_5c94_448c_9610_186923ae148b.slice/crio-afe0961145821b37ab520ab40bf9a86f4d3613cb43a8528ada6287e24f7f3168 WatchSource:0}: Error finding container afe0961145821b37ab520ab40bf9a86f4d3613cb43a8528ada6287e24f7f3168: Status 404 returned error can't find the container with id afe0961145821b37ab520ab40bf9a86f4d3613cb43a8528ada6287e24f7f3168
Jul 07 02:24:04.114006 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:04.113896    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"]
Jul 07 02:24:04.118682 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:24:04.118654    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2509d8_c00e_4b99_befc_f7dee1b6b5d5.slice/crio-2e848c79ae138d5df2ccd4d7cc528cdad58a4b937a53674d23b5b77b458a6064 WatchSource:0}: Error finding container 2e848c79ae138d5df2ccd4d7cc528cdad58a4b937a53674d23b5b77b458a6064: Status 404 returned error can't find the container with id 2e848c79ae138d5df2ccd4d7cc528cdad58a4b937a53674d23b5b77b458a6064
Jul 07 02:24:04.408068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:04.407913    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5" event={"ID":"23179b3a-5c94-448c-9610-186923ae148b","Type":"ContainerStarted","Data":"afe0961145821b37ab520ab40bf9a86f4d3613cb43a8528ada6287e24f7f3168"}
Jul 07 02:24:04.409516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:04.409484    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr" event={"ID":"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5","Type":"ContainerStarted","Data":"2e848c79ae138d5df2ccd4d7cc528cdad58a4b937a53674d23b5b77b458a6064"}
Jul 07 02:24:08.197235 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.197195    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:24:08.197646 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.197272    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:24:08.197646 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.197298    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:24:08.436387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.436292    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5" event={"ID":"23179b3a-5c94-448c-9610-186923ae148b","Type":"ContainerStarted","Data":"ac33fce1f2d14ba1cdafcab38389cb8d6c6d8c4fde053cd8eee1e7bc1832eaa8"}
Jul 07 02:24:08.436387 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.436358    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:08.438410 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.438377    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr" event={"ID":"4a2509d8-c00e-4b99-befc-f7dee1b6b5d5","Type":"ContainerStarted","Data":"bcfb993f90966b84f417147d0e0da0eb7b332e31ae113d01e1a04510fa35ef47"}
Jul 07 02:24:08.445612 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.445553    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj" event={"ID":"f0a518e4-031d-4cfd-9919-59ba02b7e6a0","Type":"ContainerStarted","Data":"333ffd4116fcecaf5e5fea030c0a33c48b87a259f7622f787da8ac98f17b2825"}
Jul 07 02:24:08.446607 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.446579    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:24:08.459599 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.459546    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5" podStartSLOduration=2.2831277549999998 podStartE2EDuration="6.459527344s" totalImagesPullingTime="4.176399589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:08.457148219 +0000 UTC m=+561.742003483" watchObservedRunningTime="2026-07-07 02:24:08.459527344 +0000 UTC m=+561.744382604"
Jul 07 02:24:08.476811 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.476746    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj" podStartSLOduration=1.620778361 podStartE2EDuration="6.47672398s" totalImagesPullingTime="4.855945619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:08.475208338 +0000 UTC m=+561.760063600" watchObservedRunningTime="2026-07-07 02:24:08.47672398 +0000 UTC m=+561.761579247"
Jul 07 02:24:08.497939 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.497877    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr" podStartSLOduration=1.422390152 podStartE2EDuration="5.497859606s" totalImagesPullingTime="4.075469454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:08.496655586 +0000 UTC m=+561.781510849" watchObservedRunningTime="2026-07-07 02:24:08.497859606 +0000 UTC m=+561.782714867"
Jul 07 02:24:08.933699 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:08.933655    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:09.938617 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:09.938585    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:10.455589 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:10.455544    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:10.456379 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:10.456362    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47gfqr"
Jul 07 02:24:13.403949 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:13.403899    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-2mvdz"
Jul 07 02:24:39.453008 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:39.452976    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7ndd5"
Jul 07 02:24:40.460524 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:24:40.460487    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dktrj"
Jul 07 02:26:45.738335 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.738297    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:45.741476 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.741453    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:45.743529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.743498    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 02:26:45.743529 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.743498    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 02:26:45.743834 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.743821    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxxrr\""
Jul 07 02:26:45.746994 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.746970    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:45.830178 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.830138    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rl2w\" (UniqueName: \"kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w\") pod \"authorino-58cd955675-kjlx6\" (UID: \"53c1e3ea-8083-4d11-bdaf-b6722d528a44\") " pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:45.931450 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.931411    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rl2w\" (UniqueName: \"kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w\") pod \"authorino-58cd955675-kjlx6\" (UID: \"53c1e3ea-8083-4d11-bdaf-b6722d528a44\") " pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:45.941846 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:45.941818    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rl2w\" (UniqueName: \"kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w\") pod \"authorino-58cd955675-kjlx6\" (UID: \"53c1e3ea-8083-4d11-bdaf-b6722d528a44\") " pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:46.059054 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:46.059008    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:46.196530 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:46.196474    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:46.199590 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:26:46.199541    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53c1e3ea_8083_4d11_bdaf_b6722d528a44.slice/crio-950557086b7b9b3cf95f693f5ca98d9d46d8ac5ba35f49945ce06bafdfb58fb1 WatchSource:0}: Error finding container 950557086b7b9b3cf95f693f5ca98d9d46d8ac5ba35f49945ce06bafdfb58fb1: Status 404 returned error can't find the container with id 950557086b7b9b3cf95f693f5ca98d9d46d8ac5ba35f49945ce06bafdfb58fb1
Jul 07 02:26:46.201076 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:46.201055    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:26:47.212471 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:47.212430    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjlx6" event={"ID":"53c1e3ea-8083-4d11-bdaf-b6722d528a44","Type":"ContainerStarted","Data":"950557086b7b9b3cf95f693f5ca98d9d46d8ac5ba35f49945ce06bafdfb58fb1"}
Jul 07 02:26:50.229344 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:50.229310    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjlx6" event={"ID":"53c1e3ea-8083-4d11-bdaf-b6722d528a44","Type":"ContainerStarted","Data":"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"}
Jul 07 02:26:50.243905 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:50.243852    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kjlx6" podStartSLOduration=2.210770518 podStartE2EDuration="5.243835871s" totalImagesPullingTime="3.033065353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:50.242726672 +0000 UTC m=+723.527581913" watchObservedRunningTime="2026-07-07 02:26:50.243835871 +0000 UTC m=+723.528691132"
Jul 07 02:26:51.111899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:51.111857    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:52.239360 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:52.239321    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kjlx6" podUID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" containerName="authorino" containerID="cri-o://6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20" gracePeriod=30
Jul 07 02:26:52.488575 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:52.488551    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:52.605678 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:52.605644    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rl2w\" (UniqueName: \"kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w\") pod \"53c1e3ea-8083-4d11-bdaf-b6722d528a44\" (UID: \"53c1e3ea-8083-4d11-bdaf-b6722d528a44\") "
Jul 07 02:26:52.608058 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:52.608036    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w" (OuterVolumeSpecName: "kube-api-access-5rl2w") pod "53c1e3ea-8083-4d11-bdaf-b6722d528a44" (UID: "53c1e3ea-8083-4d11-bdaf-b6722d528a44"). InnerVolumeSpecName "kube-api-access-5rl2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:52.706729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:52.706694    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rl2w\" (UniqueName: \"kubernetes.io/projected/53c1e3ea-8083-4d11-bdaf-b6722d528a44-kube-api-access-5rl2w\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:26:53.245783 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.245744    2545 generic.go:356] "Generic (PLEG): container finished" podID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" containerID="6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20" exitCode=0
Jul 07 02:26:53.246306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.245788    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjlx6"
Jul 07 02:26:53.246306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.245838    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjlx6" event={"ID":"53c1e3ea-8083-4d11-bdaf-b6722d528a44","Type":"ContainerDied","Data":"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"}
Jul 07 02:26:53.246306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.245889    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjlx6" event={"ID":"53c1e3ea-8083-4d11-bdaf-b6722d528a44","Type":"ContainerDied","Data":"950557086b7b9b3cf95f693f5ca98d9d46d8ac5ba35f49945ce06bafdfb58fb1"}
Jul 07 02:26:53.246306 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.245944    2545 scope.go:117] "RemoveContainer" containerID="6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"
Jul 07 02:26:53.255178 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.255161    2545 scope.go:117] "RemoveContainer" containerID="6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"
Jul 07 02:26:53.255452 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:26:53.255433    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20\": container with ID starting with 6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20 not found: ID does not exist" containerID="6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"
Jul 07 02:26:53.255511 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.255461    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20"} err="failed to get container status \"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20\": rpc error: code = NotFound desc = could not find container \"6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20\": container with ID starting with 6fc2d9e921acca89330110da6f7d408d70501ec8e69274f96ebd1f884eff7c20 not found: ID does not exist"
Jul 07 02:26:53.266710 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.266684    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:53.270242 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:53.270219    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjlx6"]
Jul 07 02:26:55.265081 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:26:55.265044    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" path="/var/lib/kubelet/pods/53c1e3ea-8083-4d11-bdaf-b6722d528a44/volumes"
Jul 07 02:27:19.571756 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.571714    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:19.572388 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.572322    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" containerName="authorino"
Jul 07 02:27:19.572388 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.572344    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" containerName="authorino"
Jul 07 02:27:19.572506 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.572431    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="53c1e3ea-8083-4d11-bdaf-b6722d528a44" containerName="authorino"
Jul 07 02:27:19.575949 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.575913    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:19.578101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.578079    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxxrr\""
Jul 07 02:27:19.578232 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.578100    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 02:27:19.578545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.578528    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 02:27:19.581321 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.581294    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:19.657187 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.657151    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2fgj\" (UniqueName: \"kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj\") pod \"authorino-5d4b67c446-lqxq2\" (UID: \"36530c85-da81-40fe-b462-6fe68b70a2f2\") " pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:19.758492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.758453    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2fgj\" (UniqueName: \"kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj\") pod \"authorino-5d4b67c446-lqxq2\" (UID: \"36530c85-da81-40fe-b462-6fe68b70a2f2\") " pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:19.766354 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.766325    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2fgj\" (UniqueName: \"kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj\") pod \"authorino-5d4b67c446-lqxq2\" (UID: \"36530c85-da81-40fe-b462-6fe68b70a2f2\") " pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:19.804141 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.804099    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:19.804412 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.804400    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:19.946807 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:19.946781    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:19.949521 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:27:19.949493    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36530c85_da81_40fe_b462_6fe68b70a2f2.slice/crio-3a51fd64159f0850a821f853d6d2626a93b4d549a72c5d7cc661f148d2416f5a WatchSource:0}: Error finding container 3a51fd64159f0850a821f853d6d2626a93b4d549a72c5d7cc661f148d2416f5a: Status 404 returned error can't find the container with id 3a51fd64159f0850a821f853d6d2626a93b4d549a72c5d7cc661f148d2416f5a
Jul 07 02:27:20.375237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:20.375209    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" event={"ID":"36530c85-da81-40fe-b462-6fe68b70a2f2","Type":"ContainerStarted","Data":"3a51fd64159f0850a821f853d6d2626a93b4d549a72c5d7cc661f148d2416f5a"}
Jul 07 02:27:21.384612 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.384570    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" event={"ID":"36530c85-da81-40fe-b462-6fe68b70a2f2","Type":"ContainerStarted","Data":"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"}
Jul 07 02:27:21.385041 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.384639    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" podUID="36530c85-da81-40fe-b462-6fe68b70a2f2" containerName="authorino" containerID="cri-o://849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a" gracePeriod=30
Jul 07 02:27:21.399956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.399887    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" podStartSLOduration=1.997248871 podStartE2EDuration="2.399869434s" totalImagesPullingTime="402.620563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:21.398128825 +0000 UTC m=+754.682984086" watchObservedRunningTime="2026-07-07 02:27:21.399869434 +0000 UTC m=+754.684724694"
Jul 07 02:27:21.635433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.635359    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:21.780437 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.780398    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2fgj\" (UniqueName: \"kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj\") pod \"36530c85-da81-40fe-b462-6fe68b70a2f2\" (UID: \"36530c85-da81-40fe-b462-6fe68b70a2f2\") "
Jul 07 02:27:21.782679 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.782646    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj" (OuterVolumeSpecName: "kube-api-access-c2fgj") pod "36530c85-da81-40fe-b462-6fe68b70a2f2" (UID: "36530c85-da81-40fe-b462-6fe68b70a2f2"). InnerVolumeSpecName "kube-api-access-c2fgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:27:21.881326 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:21.881272    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2fgj\" (UniqueName: \"kubernetes.io/projected/36530c85-da81-40fe-b462-6fe68b70a2f2-kube-api-access-c2fgj\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:27:22.390282 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.390246    2545 generic.go:356] "Generic (PLEG): container finished" podID="36530c85-da81-40fe-b462-6fe68b70a2f2" containerID="849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a" exitCode=0
Jul 07 02:27:22.390668 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.390301    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" event={"ID":"36530c85-da81-40fe-b462-6fe68b70a2f2","Type":"ContainerDied","Data":"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"}
Jul 07 02:27:22.390668 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.390306    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lqxq2"
Jul 07 02:27:22.390668 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.390334    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lqxq2" event={"ID":"36530c85-da81-40fe-b462-6fe68b70a2f2","Type":"ContainerDied","Data":"3a51fd64159f0850a821f853d6d2626a93b4d549a72c5d7cc661f148d2416f5a"}
Jul 07 02:27:22.390668 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.390350    2545 scope.go:117] "RemoveContainer" containerID="849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"
Jul 07 02:27:22.399788 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.399769    2545 scope.go:117] "RemoveContainer" containerID="849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"
Jul 07 02:27:22.400107 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:27:22.400086    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a\": container with ID starting with 849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a not found: ID does not exist" containerID="849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"
Jul 07 02:27:22.400178 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.400118    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a"} err="failed to get container status \"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a\": rpc error: code = NotFound desc = could not find container \"849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a\": container with ID starting with 849221eb674d8b68833bdf44befc13c34a60d3a3334ea22c06457dd337a09f1a not found: ID does not exist"
Jul 07 02:27:22.411231 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.411196    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:22.412887 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:22.412861    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lqxq2"]
Jul 07 02:27:23.259834 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:27:23.259802    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36530c85-da81-40fe-b462-6fe68b70a2f2" path="/var/lib/kubelet/pods/36530c85-da81-40fe-b462-6fe68b70a2f2/volumes"
Jul 07 02:28:36.623843 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.623808    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"]
Jul 07 02:28:36.624336 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.624230    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36530c85-da81-40fe-b462-6fe68b70a2f2" containerName="authorino"
Jul 07 02:28:36.624336 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.624242    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="36530c85-da81-40fe-b462-6fe68b70a2f2" containerName="authorino"
Jul 07 02:28:36.624336 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.624294    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="36530c85-da81-40fe-b462-6fe68b70a2f2" containerName="authorino"
Jul 07 02:28:36.627661 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.627642    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.629770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.629746    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 02:28:36.629890 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.629833    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ngg6b\""
Jul 07 02:28:36.630287 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.630272    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 02:28:36.630365 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.630300    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 02:28:36.636182 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.636151    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"]
Jul 07 02:28:36.673348 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673306    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npx6c\" (UniqueName: \"kubernetes.io/projected/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-kube-api-access-npx6c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.673521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673356    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.673521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673389    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.673521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673432    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.673521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673448    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.673521 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.673481    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774602    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774643    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774894 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774662    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774894 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774712    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npx6c\" (UniqueName: \"kubernetes.io/projected/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-kube-api-access-npx6c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774894 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774742    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.774894 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.774786    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.775145 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.775115    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.775200 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.775158    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.775472 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.775447    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.777509 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.777487    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.777650 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.777550    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.783146 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.783123    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npx6c\" (UniqueName: \"kubernetes.io/projected/aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92-kube-api-access-npx6c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvq68\" (UID: \"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:36.939383 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:36.939285    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:37.077993 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:37.077961    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"]
Jul 07 02:28:37.081147 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:28:37.081114    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeee70fa_2cb9_4bfb_95d5_a4fe6c48ab92.slice/crio-68cbe28b189235278ce2795cb80df7ee349e63a50e2be44caa0dc18c6187ce19 WatchSource:0}: Error finding container 68cbe28b189235278ce2795cb80df7ee349e63a50e2be44caa0dc18c6187ce19: Status 404 returned error can't find the container with id 68cbe28b189235278ce2795cb80df7ee349e63a50e2be44caa0dc18c6187ce19
Jul 07 02:28:37.752934 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:37.752877    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68" event={"ID":"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92","Type":"ContainerStarted","Data":"68cbe28b189235278ce2795cb80df7ee349e63a50e2be44caa0dc18c6187ce19"}
Jul 07 02:28:38.759464 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:38.759432    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68" event={"ID":"aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92","Type":"ContainerStarted","Data":"186022f20d82ac95958df7c64db1666e3ebe46f4320d465de2b9c654d8de6691"}
Jul 07 02:28:38.779008 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:38.778944    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68" podStartSLOduration=1.738265298 podStartE2EDuration="2.778907457s" totalImagesPullingTime="1.040642159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:38.775741932 +0000 UTC m=+832.060597194" watchObservedRunningTime="2026-07-07 02:28:38.778907457 +0000 UTC m=+832.063762724"
Jul 07 02:28:46.940407 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:46.940370    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:46.940875 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:46.940556    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:46.953047 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:46.953018    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:47.817843 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:47.817817    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvq68"
Jul 07 02:28:54.705667 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.705631    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"]
Jul 07 02:28:54.709383 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.709358    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.712316 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.712291    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 02:28:54.733987 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.733954    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"]
Jul 07 02:28:54.846670 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846637    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6ff155b-be3e-49a7-b838-5a048e705d91-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.846842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846692    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.846842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846746    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.846842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846789    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wns\" (UniqueName: \"kubernetes.io/projected/e6ff155b-be3e-49a7-b838-5a048e705d91-kube-api-access-l8wns\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.846842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846814    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.846842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.846837    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948327 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948286    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948345    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wns\" (UniqueName: \"kubernetes.io/projected/e6ff155b-be3e-49a7-b838-5a048e705d91-kube-api-access-l8wns\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948372    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948395    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948437    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6ff155b-be3e-49a7-b838-5a048e705d91-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948519 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948475    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948821    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.948953 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948875    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.949023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.948971    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.950860 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.950843    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6ff155b-be3e-49a7-b838-5a048e705d91-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.951010 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.950991    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6ff155b-be3e-49a7-b838-5a048e705d91-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:54.956209 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:54.956155    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wns\" (UniqueName: \"kubernetes.io/projected/e6ff155b-be3e-49a7-b838-5a048e705d91-kube-api-access-l8wns\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb\" (UID: \"e6ff155b-be3e-49a7-b838-5a048e705d91\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:55.020411 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:55.020371    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:28:55.164861 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:55.164757    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"]
Jul 07 02:28:55.167370 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:28:55.167337    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ff155b_be3e_49a7_b838_5a048e705d91.slice/crio-7660561c6b29d12dd98a56bdbe10e34480b6ff1cb2d7df18c449cd89ca792361 WatchSource:0}: Error finding container 7660561c6b29d12dd98a56bdbe10e34480b6ff1cb2d7df18c449cd89ca792361: Status 404 returned error can't find the container with id 7660561c6b29d12dd98a56bdbe10e34480b6ff1cb2d7df18c449cd89ca792361
Jul 07 02:28:55.845952 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:55.845883    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb" event={"ID":"e6ff155b-be3e-49a7-b838-5a048e705d91","Type":"ContainerStarted","Data":"6f7573de2febb95a2143aeb30f35bd7fff637a795fb5a54b4feed74d7fb4b4b1"}
Jul 07 02:28:55.846356 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:55.845967    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb" event={"ID":"e6ff155b-be3e-49a7-b838-5a048e705d91","Type":"ContainerStarted","Data":"7660561c6b29d12dd98a56bdbe10e34480b6ff1cb2d7df18c449cd89ca792361"}
Jul 07 02:28:55.862631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:28:55.862581    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb" podStartSLOduration=1.651216229 podStartE2EDuration="1.862563739s" totalImagesPullingTime="211.34751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:55.861358032 +0000 UTC m=+849.146213294" watchObservedRunningTime="2026-07-07 02:28:55.862563739 +0000 UTC m=+849.147419000"
Jul 07 02:29:05.020853 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:05.020808    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:29:05.021369 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:05.020880    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:29:05.033534 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:05.033509    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:29:05.917960 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:05.917912    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb"
Jul 07 02:29:24.545619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.545569    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"]
Jul 07 02:29:24.549391 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.549365    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.551729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.551695    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 02:29:24.573069 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.573034    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"]
Jul 07 02:29:24.631076 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631029    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.631257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631083    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.631257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631147    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.631257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631185    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.631375 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631266    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrlp\" (UniqueName: \"kubernetes.io/projected/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-kube-api-access-xwrlp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.631375 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.631320    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732443 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732404    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrlp\" (UniqueName: \"kubernetes.io/projected/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-kube-api-access-xwrlp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732462    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732501    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732522    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732545    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732571    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.732984 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.732962    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.733044 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.733013    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.733088 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.733056    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.735109 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.735084    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.735404 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.735382    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.742213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.742182    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrlp\" (UniqueName: \"kubernetes.io/projected/0ff3f2b1-3c49-4f19-ada0-06bbe991c653-kube-api-access-xwrlp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n\" (UID: \"0ff3f2b1-3c49-4f19-ada0-06bbe991c653\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:24.875549 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:24.875441    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:25.026372 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:25.026343    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"]
Jul 07 02:29:25.032109 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:29:25.032068    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ff3f2b1_3c49_4f19_ada0_06bbe991c653.slice/crio-8365f20f7cfdb71d05f54b345de4f8661e586ab012fe157226df2757ed0d4f33 WatchSource:0}: Error finding container 8365f20f7cfdb71d05f54b345de4f8661e586ab012fe157226df2757ed0d4f33: Status 404 returned error can't find the container with id 8365f20f7cfdb71d05f54b345de4f8661e586ab012fe157226df2757ed0d4f33
Jul 07 02:29:26.012011 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:26.011981    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n" event={"ID":"0ff3f2b1-3c49-4f19-ada0-06bbe991c653","Type":"ContainerStarted","Data":"fb768f4b054b4431c28d3db116303eabed10a34ef244a2de97f880de32bac85e"}
Jul 07 02:29:26.012405 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:26.012020    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n" event={"ID":"0ff3f2b1-3c49-4f19-ada0-06bbe991c653","Type":"ContainerStarted","Data":"8365f20f7cfdb71d05f54b345de4f8661e586ab012fe157226df2757ed0d4f33"}
Jul 07 02:29:34.875879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:34.875840    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:34.876393 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:34.875899    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:34.888700 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:34.888662    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:29:34.907617 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:34.907560    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n" podStartSLOduration=10.741873413 podStartE2EDuration="10.907541062s" totalImagesPullingTime="165.667649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:29:26.029533222 +0000 UTC m=+879.314388484" watchObservedRunningTime="2026-07-07 02:29:34.907541062 +0000 UTC m=+888.192396322"
Jul 07 02:29:35.067215 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:29:35.067185    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n"
Jul 07 02:43:45.354698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.354668    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:43:45.358677 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.358650    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.361179 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.361153    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f3a52fbf-openshift-default-dockercfg-5c2pc\""
Jul 07 02:43:45.368815 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.368787    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:43:45.457706 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457669    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.457706 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457711    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457731    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457756    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457952    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.457994    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458269 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.458057    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6wfp\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458269 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.458094    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.458269 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.458135    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559641 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559597    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559641 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559639    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559663    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6wfp\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559687    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559715    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559760    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559778    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.559979 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.559827    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.560353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.560196    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.560353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.560230    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.560353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.560264    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.560567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.560546    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.560853 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.560834    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.562412 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.562392    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.562544 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.562527    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.567673 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.567643    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.567787 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.567722    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6wfp\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp\") pod \"e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") " pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.671762 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.671665    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:45.820936 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.820889    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:43:45.822618 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:43:45.822592    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c174910_62ee_4698_934d_63ee641a543f.slice/crio-5e3ba2ee5773b5e58661e03f55359f91a7e5265b3bdf927e1287e0815df7f014 WatchSource:0}: Error finding container 5e3ba2ee5773b5e58661e03f55359f91a7e5265b3bdf927e1287e0815df7f014: Status 404 returned error can't find the container with id 5e3ba2ee5773b5e58661e03f55359f91a7e5265b3bdf927e1287e0815df7f014
Jul 07 02:43:45.824891 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.824859    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:43:45.825031 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.824960    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:43:45.825031 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:45.825003    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:43:46.278511 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:46.278471    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" event={"ID":"6c174910-62ee-4698-934d-63ee641a543f","Type":"ContainerStarted","Data":"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"}
Jul 07 02:43:46.278685 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:46.278565    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" event={"ID":"6c174910-62ee-4698-934d-63ee641a543f","Type":"ContainerStarted","Data":"5e3ba2ee5773b5e58661e03f55359f91a7e5265b3bdf927e1287e0815df7f014"}
Jul 07 02:43:46.298439 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:46.298211    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" podStartSLOduration=1.298188505 podStartE2EDuration="1.298188505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:46.298018465 +0000 UTC m=+1739.582873727" watchObservedRunningTime="2026-07-07 02:43:46.298188505 +0000 UTC m=+1739.583043769"
Jul 07 02:43:46.671999 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:46.671958    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:46.677898 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:46.677870    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:47.283895 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:47.283867    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:47.284870 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:47.284853    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:43:57.697715 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:57.697628    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:43:57.698110 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:43:57.697867    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" podUID="6c174910-62ee-4698-934d-63ee641a543f" containerName="istio-proxy" containerID="cri-o://b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad" gracePeriod=30
Jul 07 02:44:00.560638 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.560556    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:44:00.616465 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616438    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616470    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616504    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616553    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616598    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6wfp\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616629    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616670    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616716    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616776    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket\") pod \"6c174910-62ee-4698-934d-63ee641a543f\" (UID: \"6c174910-62ee-4698-934d-63ee641a543f\") "
Jul 07 02:44:00.616906 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616865    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:00.617141 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.616938    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:44:00.617141 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.617080    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:00.617241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.617219    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:00.617298 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.617268    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.617298 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.617292    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c174910-62ee-4698-934d-63ee641a543f-istiod-ca-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.617400 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.617307    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-credential-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.618092 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.618054    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:00.619663 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.619607    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:00.619779 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.619702    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:44:00.619779 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.619715    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp" (OuterVolumeSpecName: "kube-api-access-s6wfp") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "kube-api-access-s6wfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:44:00.619905 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.619785    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c174910-62ee-4698-934d-63ee641a543f" (UID: "6c174910-62ee-4698-934d-63ee641a543f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:44:00.718605 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718564    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-data\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.718605 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718603    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6wfp\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-kube-api-access-s6wfp\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.718605 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718613    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-istio-envoy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.718899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718622    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c174910-62ee-4698-934d-63ee641a543f-workload-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.718899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718630    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c174910-62ee-4698-934d-63ee641a543f-istio-podinfo\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:00.718899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:00.718637    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c174910-62ee-4698-934d-63ee641a543f-istio-token\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:44:01.355358 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.355326    2545 generic.go:356] "Generic (PLEG): container finished" podID="6c174910-62ee-4698-934d-63ee641a543f" containerID="b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad" exitCode=0
Jul 07 02:44:01.355538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.355373    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" event={"ID":"6c174910-62ee-4698-934d-63ee641a543f","Type":"ContainerDied","Data":"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"}
Jul 07 02:44:01.355538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.355417    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59" event={"ID":"6c174910-62ee-4698-934d-63ee641a543f","Type":"ContainerDied","Data":"5e3ba2ee5773b5e58661e03f55359f91a7e5265b3bdf927e1287e0815df7f014"}
Jul 07 02:44:01.355538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.355438    2545 scope.go:117] "RemoveContainer" containerID="b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"
Jul 07 02:44:01.355538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.355376    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"
Jul 07 02:44:01.364966 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.364955    2545 scope.go:117] "RemoveContainer" containerID="b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"
Jul 07 02:44:01.365264 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:44:01.365236    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad\": container with ID starting with b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad not found: ID does not exist" containerID="b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"
Jul 07 02:44:01.365351 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.365266    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad"} err="failed to get container status \"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad\": rpc error: code = NotFound desc = could not find container \"b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad\": container with ID starting with b33a46a3c37b56f1d8c21aa1856406bdb0ce3deb88a2fdc8aebf34b98695c1ad not found: ID does not exist"
Jul 07 02:44:01.371226 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.371201    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:44:01.377210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:01.377186    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f3a52fbf-openshift-default-77f8f7455c-zlq59"]
Jul 07 02:44:03.259736 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:44:03.259704    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c174910-62ee-4698-934d-63ee641a543f" path="/var/lib/kubelet/pods/6c174910-62ee-4698-934d-63ee641a543f/volumes"
Jul 07 02:46:48.239698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.239662    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:46:48.240182 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.240105    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c174910-62ee-4698-934d-63ee641a543f" containerName="istio-proxy"
Jul 07 02:46:48.240182 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.240119    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c174910-62ee-4698-934d-63ee641a543f" containerName="istio-proxy"
Jul 07 02:46:48.240258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.240202    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c174910-62ee-4698-934d-63ee641a543f" containerName="istio-proxy"
Jul 07 02:46:48.243478 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.243460    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.246485 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.246463    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d71dd72e\"/\"kube-root-ca.crt\""
Jul 07 02:46:48.246628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.246494    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d71dd72e\"/\"default-dockercfg-f4dms\""
Jul 07 02:46:48.246628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.246508    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d71dd72e\"/\"openshift-service-ca.crt\""
Jul 07 02:46:48.246628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.246461    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d71dd72e\"/\"e2e-lifecycle-model-d71dd72e-kserve-self-signed-certs\""
Jul 07 02:46:48.251290 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.251257    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:46:48.314719 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.314682    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.314939 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.314758    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65ns6\" (UniqueName: \"kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.314939 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.314800    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.314939 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.314831    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.314939 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.314861    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.315177 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.315015    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.415998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65ns6\" (UniqueName: \"kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416057    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416091    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416119    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416173    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416258 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416254    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416592 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416570    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416592 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416586    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.416677 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.416637    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.418704 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.418679    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.418878 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.418859    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.423728 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.423706    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65ns6\" (UniqueName: \"kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6\") pod \"e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") " pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.553831 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.553794    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:48.699764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:48.699673    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:46:48.702867 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:46:48.702840    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf5deb07_16a6_41a1_b6ef_be205e082f0c.slice/crio-8fd5dc0ef0b12a54d0fd561bc496262db34c078c84bbedf00489ee3e65425255 WatchSource:0}: Error finding container 8fd5dc0ef0b12a54d0fd561bc496262db34c078c84bbedf00489ee3e65425255: Status 404 returned error can't find the container with id 8fd5dc0ef0b12a54d0fd561bc496262db34c078c84bbedf00489ee3e65425255
Jul 07 02:46:49.200353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:49.200321    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" event={"ID":"bf5deb07-16a6-41a1-b6ef-be205e082f0c","Type":"ContainerStarted","Data":"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"}
Jul 07 02:46:49.200543 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:49.200364    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" event={"ID":"bf5deb07-16a6-41a1-b6ef-be205e082f0c","Type":"ContainerStarted","Data":"8fd5dc0ef0b12a54d0fd561bc496262db34c078c84bbedf00489ee3e65425255"}
Jul 07 02:46:49.217168 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:49.217115    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" podStartSLOduration=1.21709983 podStartE2EDuration="1.21709983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:46:49.215716956 +0000 UTC m=+1922.500572215" watchObservedRunningTime="2026-07-07 02:46:49.21709983 +0000 UTC m=+1922.501955091"
Jul 07 02:46:58.554662 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:58.554621    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:58.555183 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:58.554682    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:58.567631 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:58.567601    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:46:59.261380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:46:59.261350    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:47:17.385556 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:17.385514    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:47:32.408614 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.408569    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" podUID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" containerName="main" containerID="cri-o://4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e" gracePeriod=45
Jul 07 02:47:32.672834 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.672757    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:47:32.750086 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750048    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65ns6\" (UniqueName: \"kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750113    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750162    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750201    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750224    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750257    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir\") pod \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\" (UID: \"bf5deb07-16a6-41a1-b6ef-be205e082f0c\") "
Jul 07 02:47:32.750616 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750537    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:47:32.750616 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750551    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home" (OuterVolumeSpecName: "home") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:47:32.751955 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.750612    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:47:32.751955 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.751217    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:32.751955 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.751236    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:32.758799 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.758607    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:47:32.759049 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.758986    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm" (OuterVolumeSpecName: "dshm") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:47:32.759216 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.759180    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6" (OuterVolumeSpecName: "kube-api-access-65ns6") pod "bf5deb07-16a6-41a1-b6ef-be205e082f0c" (UID: "bf5deb07-16a6-41a1-b6ef-be205e082f0c"). InnerVolumeSpecName "kube-api-access-65ns6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:47:32.852419 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.852381    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65ns6\" (UniqueName: \"kubernetes.io/projected/bf5deb07-16a6-41a1-b6ef-be205e082f0c-kube-api-access-65ns6\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:32.852419 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.852412    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:32.852419 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.852423    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:32.852665 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:32.852453    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5deb07-16a6-41a1-b6ef-be205e082f0c-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:47:33.422018 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.421979    2545 generic.go:356] "Generic (PLEG): container finished" podID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" containerID="4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e" exitCode=0
Jul 07 02:47:33.422428 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.422048    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"
Jul 07 02:47:33.422428 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.422060    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" event={"ID":"bf5deb07-16a6-41a1-b6ef-be205e082f0c","Type":"ContainerDied","Data":"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"}
Jul 07 02:47:33.422428 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.422102    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm" event={"ID":"bf5deb07-16a6-41a1-b6ef-be205e082f0c","Type":"ContainerDied","Data":"8fd5dc0ef0b12a54d0fd561bc496262db34c078c84bbedf00489ee3e65425255"}
Jul 07 02:47:33.422428 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.422122    2545 scope.go:117] "RemoveContainer" containerID="4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"
Jul 07 02:47:33.431580 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.431557    2545 scope.go:117] "RemoveContainer" containerID="4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"
Jul 07 02:47:33.431942 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:47:33.431908    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e\": container with ID starting with 4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e not found: ID does not exist" containerID="4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"
Jul 07 02:47:33.432013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.431951    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e"} err="failed to get container status \"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e\": rpc error: code = NotFound desc = could not find container \"4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e\": container with ID starting with 4fda0f355cfc2db2107aa61622b5ac97166153e0cf0fb7fb8b87dae0d363928e not found: ID does not exist"
Jul 07 02:47:33.437560 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.437533    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:47:33.446460 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:33.446425    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d71dd72e/e2e-lifecycle-model-d71dd72e-kserve-9598c6f95-qbphm"]
Jul 07 02:47:35.260603 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:47:35.260569    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" path="/var/lib/kubelet/pods/bf5deb07-16a6-41a1-b6ef-be205e082f0c/volumes"
Jul 07 02:49:07.518667 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.518583    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:49:07.521278 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.519071    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" containerName="main"
Jul 07 02:49:07.521278 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.519086    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" containerName="main"
Jul 07 02:49:07.521278 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.519170    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf5deb07-16a6-41a1-b6ef-be205e082f0c" containerName="main"
Jul 07 02:49:07.522094 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.522073    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.524786 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.524763    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-decb12-openshift-default-dockercfg-rtcpk\""
Jul 07 02:49:07.534788 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.534760    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:49:07.690112 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690071    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2h8h\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690285 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690126    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690285 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690211    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690285 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690229    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690285 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690255    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690285 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690273    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690297    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690365    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.690457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.690407    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.791797 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.791693    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.791797 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.791752    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.791884    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.791961    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.791995    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792040    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792119    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792181    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792215    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2h8h\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792293 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792233    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792705 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792650    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792705 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792697    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.792954 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.792831    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.793343 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.793320    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.794905 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.794876    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.795012 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.794933    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.800453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.800423    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.800580 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.800559    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2h8h\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h\") pod \"e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") " pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.833996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.833964    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:07.984203 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.984175    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:49:07.986244 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:49:07.986219    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad04824_5a1a_4b3d_aca8_191cfa07c30c.slice/crio-33193fa4b8764b558c237394a90cbceabe88cb0917ba2d07e26bbaec4300b559 WatchSource:0}: Error finding container 33193fa4b8764b558c237394a90cbceabe88cb0917ba2d07e26bbaec4300b559: Status 404 returned error can't find the container with id 33193fa4b8764b558c237394a90cbceabe88cb0917ba2d07e26bbaec4300b559
Jul 07 02:49:07.988463 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.988434    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:07.988548 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.988496    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:07.988548 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:07.988523    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:08.889656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:08.889613    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerStarted","Data":"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"}
Jul 07 02:49:08.890182 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:08.889668    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerStarted","Data":"33193fa4b8764b558c237394a90cbceabe88cb0917ba2d07e26bbaec4300b559"}
Jul 07 02:49:08.909313 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:08.909263    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podStartSLOduration=1.909246116 podStartE2EDuration="1.909246116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:08.907542694 +0000 UTC m=+2062.192397957" watchObservedRunningTime="2026-07-07 02:49:08.909246116 +0000 UTC m=+2062.194101401"
Jul 07 02:49:09.834707 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:09.834667    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:09.840081 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:09.840057    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:09.894601 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:09.894570    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:09.895451 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:09.895434    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:25.113237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.112783    2545 patch_prober.go:28] interesting pod/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:58090->10.133.0.38:15021: read: connection reset by peer" start-of-body=
Jul 07 02:49:25.113237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.112864    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:58090->10.133.0.38:15021: read: connection reset by peer"
Jul 07 02:49:25.978405 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.978367    2545 generic.go:356] "Generic (PLEG): container finished" podID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerID="5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680" exitCode=0
Jul 07 02:49:25.978621 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.978444    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerDied","Data":"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"}
Jul 07 02:49:25.978913 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.978895    2545 scope.go:117] "RemoveContainer" containerID="5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"
Jul 07 02:49:25.979998 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.979969    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:25.980106 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.980036    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:25.980106 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:25.980068    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:49:26.989330 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:26.989271    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerStarted","Data":"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"}
Jul 07 02:49:27.834690 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:27.834655    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:27.834910 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:27.834820    2545 patch_prober.go:28] interesting pod/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 07 02:49:27.834910 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:27.834887    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 07 02:49:28.834530 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:28.834490    2545 patch_prober.go:28] interesting pod/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 07 02:49:28.834970 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:28.834548    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 07 02:49:29.834994 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.834957    2545 patch_prober.go:28] interesting pod/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 07 02:49:29.835377 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.835011    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 07 02:49:29.870220 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.870182    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:49:29.873033 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.873010    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.875220 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.875193    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-606263\"/\"kube-root-ca.crt\""
Jul 07 02:49:29.875706 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.875684    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-606263\"/\"test-model-606263-kserve-self-signed-certs\""
Jul 07 02:49:29.876117 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.876098    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-606263\"/\"openshift-service-ca.crt\""
Jul 07 02:49:29.876495 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.876477    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-606263\"/\"default-dockercfg-64jml\""
Jul 07 02:49:29.892127 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.887441    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:49:29.925371 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925337    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.925576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925384    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzbt\" (UniqueName: \"kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.925576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925473    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.925576 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925531    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.925712 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925581    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:29.925712 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:29.925653    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.026795 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026758    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026827    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026850    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzbt\" (UniqueName: \"kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026892    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026963    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.026988    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027368 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.027344    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027455 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.027393    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.027455 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.027427    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.029424 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.029398    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.029676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.029658    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.034737 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.034707    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzbt\" (UniqueName: \"kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt\") pod \"test-model-606263-kserve-5889c96cf-kzxjx\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") " pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.207902 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.207812    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:30.372240 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.372212    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:49:30.374119 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:49:30.374084    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1820da91_095b_4035_8556_74b7f5f1f059.slice/crio-76f95fd682c09f03fcd3f6ded5f720cb134fb85e308f4ceed3e8f4253c1b7dea WatchSource:0}: Error finding container 76f95fd682c09f03fcd3f6ded5f720cb134fb85e308f4ceed3e8f4253c1b7dea: Status 404 returned error can't find the container with id 76f95fd682c09f03fcd3f6ded5f720cb134fb85e308f4ceed3e8f4253c1b7dea
Jul 07 02:49:30.834615 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.834575    2545 patch_prober.go:28] interesting pod/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 07 02:49:30.834798 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:30.834638    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 07 02:49:31.016399 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.016358    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" event={"ID":"1820da91-095b-4035-8556-74b7f5f1f059","Type":"ContainerStarted","Data":"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"}
Jul 07 02:49:31.016833 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.016410    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" event={"ID":"1820da91-095b-4035-8556-74b7f5f1f059","Type":"ContainerStarted","Data":"76f95fd682c09f03fcd3f6ded5f720cb134fb85e308f4ceed3e8f4253c1b7dea"}
Jul 07 02:49:31.041642 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.041562    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" podStartSLOduration=2.041537319 podStartE2EDuration="2.041537319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:31.038865355 +0000 UTC m=+2084.323720630" watchObservedRunningTime="2026-07-07 02:49:31.041537319 +0000 UTC m=+2084.326392647"
Jul 07 02:49:31.838557 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.838526    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:31.838842 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.838821    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:31.839619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:31.839597    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:49:40.208004 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:40.207964    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:40.208004 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:40.208012    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:40.220453 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:40.220427    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:41.077769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:41.077734    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:49:51.935370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.935332    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:49:51.938100 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.938076    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.940194 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.940169    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-decb12\"/\"openshift-service-ca.crt\""
Jul 07 02:49:51.940443 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.940425    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-decb12\"/\"kube-root-ca.crt\""
Jul 07 02:49:51.941073 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.941052    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-decb12\"/\"test-model-decb12-kserve-self-signed-certs\""
Jul 07 02:49:51.941190 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.941099    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-decb12\"/\"default-dockercfg-v5ggc\""
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946356    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946454    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946496    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946527    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgq9n\" (UniqueName: \"kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946573    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.946593    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:51.947423 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:51.947128    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:49:52.047170 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047130    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047184    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047206    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgq9n\" (UniqueName: \"kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047243    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047258    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047320    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047635 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047537    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047726 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047707    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.047802 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.047755    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.050052 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.050021    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.050224 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.050205    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.057050 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.057028    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgq9n\" (UniqueName: \"kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n\") pod \"test-model-decb12-kserve-5f47c84fbc-qjg25\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") " pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.248727 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.248626    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:49:52.391068 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:52.391044    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:49:52.393851 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:49:52.393819    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9f20319_57ab_4a0d_b988_e4488dac4568.slice/crio-4d239b0858a5e06196fcafa3440800501489bb6ebc395e6e294c6f17c6bcc716 WatchSource:0}: Error finding container 4d239b0858a5e06196fcafa3440800501489bb6ebc395e6e294c6f17c6bcc716: Status 404 returned error can't find the container with id 4d239b0858a5e06196fcafa3440800501489bb6ebc395e6e294c6f17c6bcc716
Jul 07 02:49:53.131074 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:53.131031    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" event={"ID":"f9f20319-57ab-4a0d-b988-e4488dac4568","Type":"ContainerStarted","Data":"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"}
Jul 07 02:49:53.131074 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:53.131080    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" event={"ID":"f9f20319-57ab-4a0d-b988-e4488dac4568","Type":"ContainerStarted","Data":"4d239b0858a5e06196fcafa3440800501489bb6ebc395e6e294c6f17c6bcc716"}
Jul 07 02:49:53.148101 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:49:53.148048    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" podStartSLOduration=2.1480286140000002 podStartE2EDuration="2.148028614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:53.147207281 +0000 UTC m=+2106.432062543" watchObservedRunningTime="2026-07-07 02:49:53.148028614 +0000 UTC m=+2106.432883876"
Jul 07 02:50:02.249006 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:02.248963    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:02.249006 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:02.249012    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:02.261681 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:02.261654    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:03.196058 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:03.196026    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:18.946936 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:18.946884    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:50:20.032324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:20.032289    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:50:33.969649 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:33.969606    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" podUID="1820da91-095b-4035-8556-74b7f5f1f059" containerName="main" containerID="cri-o://8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383" gracePeriod=45
Jul 07 02:50:34.227181 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.227105    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:50:34.281865 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.281823    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282084 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.281892    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282084 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.281948    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvzbt\" (UniqueName: \"kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282084 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282066    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282264 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282221    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282321 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282262    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home\") pod \"1820da91-095b-4035-8556-74b7f5f1f059\" (UID: \"1820da91-095b-4035-8556-74b7f5f1f059\") "
Jul 07 02:50:34.282366 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282339    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:34.282572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282517    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache" (OuterVolumeSpecName: "model-cache") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:34.282572 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282555    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home" (OuterVolumeSpecName: "home") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:34.283035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282785    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.283035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282804    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.283035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.282818    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.284544 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.284515    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm" (OuterVolumeSpecName: "dshm") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:34.284544 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.284521    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt" (OuterVolumeSpecName: "kube-api-access-bvzbt") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "kube-api-access-bvzbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:50:34.284698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.284548    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1820da91-095b-4035-8556-74b7f5f1f059" (UID: "1820da91-095b-4035-8556-74b7f5f1f059"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:50:34.356991 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.356951    2545 generic.go:356] "Generic (PLEG): container finished" podID="1820da91-095b-4035-8556-74b7f5f1f059" containerID="8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383" exitCode=0
Jul 07 02:50:34.356991 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.356993    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"
Jul 07 02:50:34.357210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.357022    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" event={"ID":"1820da91-095b-4035-8556-74b7f5f1f059","Type":"ContainerDied","Data":"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"}
Jul 07 02:50:34.357210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.357071    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx" event={"ID":"1820da91-095b-4035-8556-74b7f5f1f059","Type":"ContainerDied","Data":"76f95fd682c09f03fcd3f6ded5f720cb134fb85e308f4ceed3e8f4253c1b7dea"}
Jul 07 02:50:34.357210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.357089    2545 scope.go:117] "RemoveContainer" containerID="8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"
Jul 07 02:50:34.366499 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.366478    2545 scope.go:117] "RemoveContainer" containerID="8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"
Jul 07 02:50:34.366790 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:50:34.366771    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383\": container with ID starting with 8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383 not found: ID does not exist" containerID="8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"
Jul 07 02:50:34.366846 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.366799    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383"} err="failed to get container status \"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383\": rpc error: code = NotFound desc = could not find container \"8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383\": container with ID starting with 8efb04849672325001a28b623858b4837de55b079d25dae6ebbf5a03e5d32383 not found: ID does not exist"
Jul 07 02:50:34.382769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.382737    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:50:34.383961 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.383942    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1820da91-095b-4035-8556-74b7f5f1f059-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.384021 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.383965    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1820da91-095b-4035-8556-74b7f5f1f059-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.384021 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.383974    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvzbt\" (UniqueName: \"kubernetes.io/projected/1820da91-095b-4035-8556-74b7f5f1f059-kube-api-access-bvzbt\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:34.388228 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:34.388190    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-606263/test-model-606263-kserve-5889c96cf-kzxjx"]
Jul 07 02:50:35.053873 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.053810    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" podUID="f9f20319-57ab-4a0d-b988-e4488dac4568" containerName="main" containerID="cri-o://0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f" gracePeriod=45
Jul 07 02:50:35.261129 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.261099    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1820da91-095b-4035-8556-74b7f5f1f059" path="/var/lib/kubelet/pods/1820da91-095b-4035-8556-74b7f5f1f059/volumes"
Jul 07 02:50:35.324423 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.324395    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:35.363552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.363517    2545 generic.go:356] "Generic (PLEG): container finished" podID="f9f20319-57ab-4a0d-b988-e4488dac4568" containerID="0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f" exitCode=0
Jul 07 02:50:35.363748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.363576    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"
Jul 07 02:50:35.363748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.363607    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" event={"ID":"f9f20319-57ab-4a0d-b988-e4488dac4568","Type":"ContainerDied","Data":"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"}
Jul 07 02:50:35.363748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.363647    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25" event={"ID":"f9f20319-57ab-4a0d-b988-e4488dac4568","Type":"ContainerDied","Data":"4d239b0858a5e06196fcafa3440800501489bb6ebc395e6e294c6f17c6bcc716"}
Jul 07 02:50:35.363748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.363671    2545 scope.go:117] "RemoveContainer" containerID="0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"
Jul 07 02:50:35.374630 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.374607    2545 scope.go:117] "RemoveContainer" containerID="0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"
Jul 07 02:50:35.374988 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:50:35.374970    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f\": container with ID starting with 0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f not found: ID does not exist" containerID="0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"
Jul 07 02:50:35.375059 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.374996    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f"} err="failed to get container status \"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f\": rpc error: code = NotFound desc = could not find container \"0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f\": container with ID starting with 0bd2f86fc21b01ef33342aa51630af43e44d1072c0ca041d6a268cfe48d2ee6f not found: ID does not exist"
Jul 07 02:50:35.393370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393340    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393397    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393439    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393459    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgq9n\" (UniqueName: \"kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393488    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393606    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs\") pod \"f9f20319-57ab-4a0d-b988-e4488dac4568\" (UID: \"f9f20319-57ab-4a0d-b988-e4488dac4568\") "
Jul 07 02:50:35.393769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393690    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home" (OuterVolumeSpecName: "home") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:35.393769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393740    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:35.393769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.393752    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:35.394040 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.394022    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.394097 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.394044    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.394097 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.394060    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.395936 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.395898    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm" (OuterVolumeSpecName: "dshm") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:50:35.396035 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.395955    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:50:35.396097 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.396071    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n" (OuterVolumeSpecName: "kube-api-access-sgq9n") pod "f9f20319-57ab-4a0d-b988-e4488dac4568" (UID: "f9f20319-57ab-4a0d-b988-e4488dac4568"). InnerVolumeSpecName "kube-api-access-sgq9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:50:35.495393 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.495346    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f20319-57ab-4a0d-b988-e4488dac4568-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.495393 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.495383    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgq9n\" (UniqueName: \"kubernetes.io/projected/f9f20319-57ab-4a0d-b988-e4488dac4568-kube-api-access-sgq9n\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.495393 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.495393    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f20319-57ab-4a0d-b988-e4488dac4568-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:50:35.687869 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.687838    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:50:35.694879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:35.694847    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-decb12/test-model-decb12-kserve-5f47c84fbc-qjg25"]
Jul 07 02:50:37.259748 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:50:37.259715    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9f20319-57ab-4a0d-b988-e4488dac4568" path="/var/lib/kubelet/pods/f9f20319-57ab-4a0d-b988-e4488dac4568/volumes"
Jul 07 02:51:10.591544 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:10.591504    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:51:10.592416 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:10.591746    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy" containerID="cri-o://5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6" gracePeriod=30
Jul 07 02:51:15.849451 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.849420    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:51:15.909408 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909322    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909408 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909404    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2h8h\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909625 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909441    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909625 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909497    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909625 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909525    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909625 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909553    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909625 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909575    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909641    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909672    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket\") pod \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\" (UID: \"aad04824-5a1a-4b3d-aca8-191cfa07c30c\") "
Jul 07 02:51:15.909899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909774    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:15.909899 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.909794    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:15.910149 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.910101    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:15.910212 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.910101    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:15.910470 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.910264    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-credential-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:15.910715 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.910680    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:15.910891 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.910871    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data" (OuterVolumeSpecName: "istio-data") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:15.911985 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.911960    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h" (OuterVolumeSpecName: "kube-api-access-p2h8h") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "kube-api-access-p2h8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:15.912114 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.912096    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:15.912277 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.912259    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token" (OuterVolumeSpecName: "istio-token") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:15.912446 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:15.912415    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aad04824-5a1a-4b3d-aca8-191cfa07c30c" (UID: "aad04824-5a1a-4b3d-aca8-191cfa07c30c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:51:16.011201 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011169    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istiod-ca-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011201 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011194    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-data\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011201 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011205    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-envoy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011212    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad04824-5a1a-4b3d-aca8-191cfa07c30c-workload-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011220    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-token\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011228    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2h8h\" (UniqueName: \"kubernetes.io/projected/aad04824-5a1a-4b3d-aca8-191cfa07c30c-kube-api-access-p2h8h\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.011433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.011237    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad04824-5a1a-4b3d-aca8-191cfa07c30c-istio-podinfo\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:16.570724 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.570689    2545 generic.go:356] "Generic (PLEG): container finished" podID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerID="5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6" exitCode=0
Jul 07 02:51:16.571013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.570725    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerDied","Data":"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"}
Jul 07 02:51:16.571013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.570747    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"
Jul 07 02:51:16.571013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.570787    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg" event={"ID":"aad04824-5a1a-4b3d-aca8-191cfa07c30c","Type":"ContainerDied","Data":"33193fa4b8764b558c237394a90cbceabe88cb0917ba2d07e26bbaec4300b559"}
Jul 07 02:51:16.571013 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.570813    2545 scope.go:117] "RemoveContainer" containerID="5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"
Jul 07 02:51:16.580723 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.580705    2545 scope.go:117] "RemoveContainer" containerID="5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"
Jul 07 02:51:16.589227 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.589196    2545 scope.go:117] "RemoveContainer" containerID="5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"
Jul 07 02:51:16.589489 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:51:16.589471    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6\": container with ID starting with 5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6 not found: ID does not exist" containerID="5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"
Jul 07 02:51:16.589547 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.589498    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6"} err="failed to get container status \"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6\": rpc error: code = NotFound desc = could not find container \"5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6\": container with ID starting with 5ff5c2cf4c110c7e1b0a5345c77dacfc6391da134b94a001b48c2b96b4844af6 not found: ID does not exist"
Jul 07 02:51:16.589547 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.589517    2545 scope.go:117] "RemoveContainer" containerID="5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"
Jul 07 02:51:16.589728 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:51:16.589712    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680\": container with ID starting with 5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680 not found: ID does not exist" containerID="5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"
Jul 07 02:51:16.589771 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.589734    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680"} err="failed to get container status \"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680\": rpc error: code = NotFound desc = could not find container \"5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680\": container with ID starting with 5e8cb75f635036f451ce1385da1f5363858d95ce831001db1588944b3ab3a680 not found: ID does not exist"
Jul 07 02:51:16.594971 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.594946    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:51:16.605145 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:16.605120    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-decb12-openshift-default-7bb5f66f4f-lqpkg"]
Jul 07 02:51:17.259996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:17.259955    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" path="/var/lib/kubelet/pods/aad04824-5a1a-4b3d-aca8-191cfa07c30c/volumes"
Jul 07 02:51:19.504349 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504319    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:19.504787 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504773    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504790    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504799    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1820da91-095b-4035-8556-74b7f5f1f059" containerName="main"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504808    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1820da91-095b-4035-8556-74b7f5f1f059" containerName="main"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504817    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9f20319-57ab-4a0d-b988-e4488dac4568" containerName="main"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504822    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9f20319-57ab-4a0d-b988-e4488dac4568" containerName="main"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504835    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:19.504839 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504840    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:19.505123 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504912    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:19.505123 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504968    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9f20319-57ab-4a0d-b988-e4488dac4568" containerName="main"
Jul 07 02:51:19.505123 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.504979    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="1820da91-095b-4035-8556-74b7f5f1f059" containerName="main"
Jul 07 02:51:19.509454 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.509435    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.512163 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.512138    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-67cea6-openshift-default-dockercfg-4ccm6\""
Jul 07 02:51:19.526475 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.526449    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:19.646138 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646096    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646144    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646236    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646272    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646331 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646317    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646364    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646413    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646451    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.646505 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.646475    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr44q\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.747474 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747426    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.747683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747497    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.747683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747535    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.747683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747618    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.747683 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747656    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr44q\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747695    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747723    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747851    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747896    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748082 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.747979    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748311 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.748193    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748311 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.748257    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748427 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.748398    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.748490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.748460    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.750327 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.750304    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.750582 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.750564    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.761370 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.761294    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.761494 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.761452    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr44q\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q\") pod \"e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") " pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.820888 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.820848    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:19.969451 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.969409    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:19.972787 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:51:19.972750    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb039571e_b4b4_47b0_ad10_72e2aa319933.slice/crio-e26c5380b2d033d392f01ba31a78d769948e0fe96cf03560d6ddbb4d3af13c4e WatchSource:0}: Error finding container e26c5380b2d033d392f01ba31a78d769948e0fe96cf03560d6ddbb4d3af13c4e: Status 404 returned error can't find the container with id e26c5380b2d033d392f01ba31a78d769948e0fe96cf03560d6ddbb4d3af13c4e
Jul 07 02:51:19.974903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.974874    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:19.974998 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.974989    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:19.975044 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:19.975025    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:20.594758 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:20.594717    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerStarted","Data":"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"}
Jul 07 02:51:20.595204 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:20.594780    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerStarted","Data":"e26c5380b2d033d392f01ba31a78d769948e0fe96cf03560d6ddbb4d3af13c4e"}
Jul 07 02:51:20.617549 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:20.617499    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podStartSLOduration=1.61748248 podStartE2EDuration="1.61748248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:20.614838431 +0000 UTC m=+2193.899693691" watchObservedRunningTime="2026-07-07 02:51:20.61748248 +0000 UTC m=+2193.902337800"
Jul 07 02:51:20.821685 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:20.821645    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:21.826510 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:21.826478    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:22.604772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:22.604745    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:22.605978 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:22.605956    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:38.646141 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:38.646092    2545 patch_prober.go:28] interesting pod/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 02:51:38.646738 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:38.646182    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 02:51:39.691597 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.691560    2545 generic.go:356] "Generic (PLEG): container finished" podID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerID="228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82" exitCode=0
Jul 07 02:51:39.692119 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.691633    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerDied","Data":"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"}
Jul 07 02:51:39.692188 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.692119    2545 scope.go:117] "RemoveContainer" containerID="228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"
Jul 07 02:51:39.693144 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.693119    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:39.693217 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.693186    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:39.693254 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:39.693223    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:51:40.703187 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:40.703154    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerStarted","Data":"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"}
Jul 07 02:51:40.821668 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:40.821632    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:40.821869 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:40.821846    2545 patch_prober.go:28] interesting pod/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 02:51:40.821914 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:40.821897    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 02:51:41.821294 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:41.821259    2545 patch_prober.go:28] interesting pod/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 02:51:41.821729 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:41.821328    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 02:51:42.822355 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:42.822313    2545 patch_prober.go:28] interesting pod/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 02:51:42.822769 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:42.822375    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 02:51:43.821802 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:43.821761    2545 patch_prober.go:28] interesting pod/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 02:51:43.822036 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:43.821828    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 02:51:44.845475 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:44.845441    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:44.845973 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:44.845743    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:44.847252 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:44.847232    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:49.915384 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:49.915343    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:49.915871 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:49.915532    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy" containerID="cri-o://544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435" gracePeriod=30
Jul 07 02:51:55.173771 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.173738    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:55.330563 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330522    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.330780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330575    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr44q\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.330780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330615    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.330780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330675    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.330780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330729    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.330780 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330763    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.331083 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330800    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.331083 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330835    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.331083 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.330952    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs\") pod \"b039571e-b4b4-47b0-ad10-72e2aa319933\" (UID: \"b039571e-b4b4-47b0-ad10-72e2aa319933\") "
Jul 07 02:51:55.331241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331102    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:55.331241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331203    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:55.331350 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331328    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:55.331403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331376    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-credential-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.331403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331395    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.331765 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331733    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:55.331896 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.331821    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data" (OuterVolumeSpecName: "istio-data") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:55.333189 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.333162    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q" (OuterVolumeSpecName: "kube-api-access-mr44q") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "kube-api-access-mr44q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:55.333567 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.333548    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:55.333676 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.333578    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token" (OuterVolumeSpecName: "istio-token") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:55.333733 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.333717    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b039571e-b4b4-47b0-ad10-72e2aa319933" (UID: "b039571e-b4b4-47b0-ad10-72e2aa319933"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:51:55.432687 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432655    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-workload-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432687 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432684    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-podinfo\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432687 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432694    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr44q\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-kube-api-access-mr44q\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432704    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-token\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432712    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-envoy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432721    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b039571e-b4b4-47b0-ad10-72e2aa319933-istio-data\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.432965 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.432728    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b039571e-b4b4-47b0-ad10-72e2aa319933-istiod-ca-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:51:55.779988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.779871    2545 generic.go:356] "Generic (PLEG): container finished" podID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerID="544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435" exitCode=0
Jul 07 02:51:55.779988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.779914    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"
Jul 07 02:51:55.779988 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.779970    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerDied","Data":"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"}
Jul 07 02:51:55.780219 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.780028    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7" event={"ID":"b039571e-b4b4-47b0-ad10-72e2aa319933","Type":"ContainerDied","Data":"e26c5380b2d033d392f01ba31a78d769948e0fe96cf03560d6ddbb4d3af13c4e"}
Jul 07 02:51:55.780219 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.780053    2545 scope.go:117] "RemoveContainer" containerID="544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"
Jul 07 02:51:55.790456 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.790437    2545 scope.go:117] "RemoveContainer" containerID="228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"
Jul 07 02:51:55.799962 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.799941    2545 scope.go:117] "RemoveContainer" containerID="544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"
Jul 07 02:51:55.800282 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:51:55.800261    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435\": container with ID starting with 544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435 not found: ID does not exist" containerID="544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"
Jul 07 02:51:55.800516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.800292    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435"} err="failed to get container status \"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435\": rpc error: code = NotFound desc = could not find container \"544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435\": container with ID starting with 544a9fa9ed2a80a28c17af3ba3504b21754763305a013f39a45b3b4956b2c435 not found: ID does not exist"
Jul 07 02:51:55.800516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.800311    2545 scope.go:117] "RemoveContainer" containerID="228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"
Jul 07 02:51:55.800612 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:51:55.800551    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82\": container with ID starting with 228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82 not found: ID does not exist" containerID="228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"
Jul 07 02:51:55.800612 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.800575    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82"} err="failed to get container status \"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82\": rpc error: code = NotFound desc = could not find container \"228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82\": container with ID starting with 228376222a33574412b3325ecc17befe59d634d79578d76195c84d30e6c7ec82 not found: ID does not exist"
Jul 07 02:51:55.824248 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.824210    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:55.831884 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:55.831857    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-67cea6-openshift-default-79fd48fc89-h42n7"]
Jul 07 02:51:57.264881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:57.264843    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" path="/var/lib/kubelet/pods/b039571e-b4b4-47b0-ad10-72e2aa319933/volumes"
Jul 07 02:51:59.594231 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594200    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:51:59.594628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594602    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594613    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594624    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594629    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594683    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594693    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b039571e-b4b4-47b0-ad10-72e2aa319933" containerName="istio-proxy"
Jul 07 02:51:59.594775 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.594698    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad04824-5a1a-4b3d-aca8-191cfa07c30c" containerName="istio-proxy"
Jul 07 02:51:59.598254 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.598231    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.602161 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.602137    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-890bdd-openshift-default-dockercfg-z9pwh\""
Jul 07 02:51:59.624543 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.624507    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:51:59.772620 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772577    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772633    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772720    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772765    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78zb\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772837    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772872    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.772912 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772902    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.773071 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772967    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.773071 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.772985    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.873884    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.873979    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874023 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874001    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874147    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874197    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874251    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874324 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874304    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874531 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874349    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78zb\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874531 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874419    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874638 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874528    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874697 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874677    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874751 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874701    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.874857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.874837    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.875249 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.875224    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.876843 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.876821    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.876985 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.876903    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.884295 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.884270    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78zb\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.884584 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.884566    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token\") pod \"e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") " pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:51:59.909812 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:51:59.909769    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:00.064346 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.064322    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:52:00.066978 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:52:00.066949    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47bfd2d_b0b7_4440_83b0_c31d0565638d.slice/crio-1f97e8c4ae5f57d8b5134094dc445984a0d203a73a31e459737dc07262ffa0a7 WatchSource:0}: Error finding container 1f97e8c4ae5f57d8b5134094dc445984a0d203a73a31e459737dc07262ffa0a7: Status 404 returned error can't find the container with id 1f97e8c4ae5f57d8b5134094dc445984a0d203a73a31e459737dc07262ffa0a7
Jul 07 02:52:00.069319 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.069286    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:00.069403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.069353    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:00.069403 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.069382    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:00.807600 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.807566    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerStarted","Data":"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"}
Jul 07 02:52:00.808046 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.807620    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerStarted","Data":"1f97e8c4ae5f57d8b5134094dc445984a0d203a73a31e459737dc07262ffa0a7"}
Jul 07 02:52:00.832091 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.832039    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podStartSLOduration=1.832022107 podStartE2EDuration="1.832022107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:52:00.829316723 +0000 UTC m=+2234.114171993" watchObservedRunningTime="2026-07-07 02:52:00.832022107 +0000 UTC m=+2234.116877367"
Jul 07 02:52:00.910156 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:00.910116    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:01.916344 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:01.916312    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:02.816954 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:02.816883    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:02.817943 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:02.817900    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:15.884630 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.884536    2545 generic.go:356] "Generic (PLEG): container finished" podID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerID="c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5" exitCode=0
Jul 07 02:52:15.884630 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.884613    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerDied","Data":"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"}
Jul 07 02:52:15.885116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.885052    2545 scope.go:117] "RemoveContainer" containerID="c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"
Jul 07 02:52:15.886131 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.886106    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:15.886201 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.886174    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:15.886238 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:15.886218    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 02:52:16.911533 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:16.911493    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerStarted","Data":"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"}
Jul 07 02:52:17.818271 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:17.818235    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:17.909964 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:17.909910    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:17.911327 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:17.911297    2545 patch_prober.go:28] interesting pod/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 02:52:17.911480 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:17.911354    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 02:52:18.910446 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:18.910405    2545 patch_prober.go:28] interesting pod/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 02:52:18.910957 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:18.910468    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 02:52:19.910483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:19.910443    2545 patch_prober.go:28] interesting pod/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 07 02:52:19.910898 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:19.910520    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 07 02:52:20.914283 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:20.914244    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:20.915263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:20.915243    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:52:47.159741 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.159711    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:52:47.162538 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.162515    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.165394 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.165361    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"auth-test-model-bb462a-kserve-self-signed-certs\""
Jul 07 02:52:47.165394 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.165381    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"default-dockercfg-x4hbk\""
Jul 07 02:52:47.165611 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.165486    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"kube-root-ca.crt\""
Jul 07 02:52:47.165611 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.165529    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"openshift-service-ca.crt\""
Jul 07 02:52:47.180982 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.180948    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:52:47.259263 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259233    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.259467 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259292    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.259467 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259379    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.259467 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259454    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.259637 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259593    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.259695 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.259633    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgff\" (UniqueName: \"kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361158 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361115    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361158 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361165    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361187    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361239    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361262    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgff\" (UniqueName: \"kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361436 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361288    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361698 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361671    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361753 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361696    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.361753 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.361722    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.363863 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.363836    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.364039 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.364021    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.370881 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.370857    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgff\" (UniqueName: \"kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff\") pod \"auth-test-model-bb462a-kserve-77f67d9c55-8hwgg\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") " pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.472148 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.472108    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:47.630014 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:47.629990    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:52:47.632571 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:52:47.632534    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf6feca7_26b3_41fa_a3b0_509600d6071c.slice/crio-3fd58b8e9f3c83934060478f5253e3eef57a99fe32c09bbef27aef8151895bb0 WatchSource:0}: Error finding container 3fd58b8e9f3c83934060478f5253e3eef57a99fe32c09bbef27aef8151895bb0: Status 404 returned error can't find the container with id 3fd58b8e9f3c83934060478f5253e3eef57a99fe32c09bbef27aef8151895bb0
Jul 07 02:52:48.071471 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:48.071433    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" event={"ID":"af6feca7-26b3-41fa-a3b0-509600d6071c","Type":"ContainerStarted","Data":"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"}
Jul 07 02:52:48.071671 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:48.071483    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" event={"ID":"af6feca7-26b3-41fa-a3b0-509600d6071c","Type":"ContainerStarted","Data":"3fd58b8e9f3c83934060478f5253e3eef57a99fe32c09bbef27aef8151895bb0"}
Jul 07 02:52:48.094610 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:48.094560    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" podStartSLOduration=1.094542527 podStartE2EDuration="1.094542527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:52:48.093733825 +0000 UTC m=+2281.378589088" watchObservedRunningTime="2026-07-07 02:52:48.094542527 +0000 UTC m=+2281.379397787"
Jul 07 02:52:57.472462 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:57.472430    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:57.472971 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:57.472475    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:57.489527 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:57.489499    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:52:58.133627 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:52:58.133593    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:55:32.253315 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:32.253236    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:55:47.274709 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.274666    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" podUID="af6feca7-26b3-41fa-a3b0-509600d6071c" containerName="main" containerID="cri-o://8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781" gracePeriod=45
Jul 07 02:55:47.539472 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.539407    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:55:47.594990 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.594961    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595184 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595000    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595184 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595048    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595184 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595089    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595184 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595121    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595184 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595166    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sgff\" (UniqueName: \"kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff\") pod \"af6feca7-26b3-41fa-a3b0-509600d6071c\" (UID: \"af6feca7-26b3-41fa-a3b0-509600d6071c\") "
Jul 07 02:55:47.595458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595365    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache" (OuterVolumeSpecName: "model-cache") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:55:47.595458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595377    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home" (OuterVolumeSpecName: "home") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:55:47.595458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595403    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:55:47.595633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595524    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.595633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595544    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.595633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.595559    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.597539 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.597507    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:55:47.597665 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.597561    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm" (OuterVolumeSpecName: "dshm") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:55:47.597665 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.597584    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff" (OuterVolumeSpecName: "kube-api-access-4sgff") pod "af6feca7-26b3-41fa-a3b0-509600d6071c" (UID: "af6feca7-26b3-41fa-a3b0-509600d6071c"). InnerVolumeSpecName "kube-api-access-4sgff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:55:47.696241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.696194    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af6feca7-26b3-41fa-a3b0-509600d6071c-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.696241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.696232    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sgff\" (UniqueName: \"kubernetes.io/projected/af6feca7-26b3-41fa-a3b0-509600d6071c-kube-api-access-4sgff\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.696241 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.696247    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af6feca7-26b3-41fa-a3b0-509600d6071c-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:55:47.986554 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.986518    2545 generic.go:356] "Generic (PLEG): container finished" podID="af6feca7-26b3-41fa-a3b0-509600d6071c" containerID="8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781" exitCode=0
Jul 07 02:55:47.986770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.986587    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"
Jul 07 02:55:47.986770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.986598    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" event={"ID":"af6feca7-26b3-41fa-a3b0-509600d6071c","Type":"ContainerDied","Data":"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"}
Jul 07 02:55:47.986770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.986644    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg" event={"ID":"af6feca7-26b3-41fa-a3b0-509600d6071c","Type":"ContainerDied","Data":"3fd58b8e9f3c83934060478f5253e3eef57a99fe32c09bbef27aef8151895bb0"}
Jul 07 02:55:47.986770 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.986661    2545 scope.go:117] "RemoveContainer" containerID="8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"
Jul 07 02:55:47.996658 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.996636    2545 scope.go:117] "RemoveContainer" containerID="8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"
Jul 07 02:55:47.996978 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:55:47.996960    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781\": container with ID starting with 8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781 not found: ID does not exist" containerID="8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"
Jul 07 02:55:47.997031 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:47.996987    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781"} err="failed to get container status \"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781\": rpc error: code = NotFound desc = could not find container \"8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781\": container with ID starting with 8d55507577a9c9ed1452150ced83d471261ef2164d0f6e4274ddf0da2d42c781 not found: ID does not exist"
Jul 07 02:55:48.007098 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:48.007071    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:55:48.011959 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:48.011931    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/auth-test-model-bb462a-kserve-77f67d9c55-8hwgg"]
Jul 07 02:55:49.259531 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:49.259495    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af6feca7-26b3-41fa-a3b0-509600d6071c" path="/var/lib/kubelet/pods/af6feca7-26b3-41fa-a3b0-509600d6071c/volumes"
Jul 07 02:55:50.164793 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.164750    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:55:50.165271 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.165252    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af6feca7-26b3-41fa-a3b0-509600d6071c" containerName="main"
Jul 07 02:55:50.165372 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.165273    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="af6feca7-26b3-41fa-a3b0-509600d6071c" containerName="main"
Jul 07 02:55:50.165433 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.165422    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="af6feca7-26b3-41fa-a3b0-509600d6071c" containerName="main"
Jul 07 02:55:50.168496 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.168473    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.172418 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.172398    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"sub-test-model-bb462a-kserve-self-signed-certs\""
Jul 07 02:55:50.172936 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.172897    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"kube-root-ca.crt\""
Jul 07 02:55:50.173043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.172944    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"openshift-service-ca.crt\""
Jul 07 02:55:50.173043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.172982    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"default-dockercfg-x4hbk\""
Jul 07 02:55:50.181666 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.181639    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:55:50.224459 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224418    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.224656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224469    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vpf\" (UniqueName: \"kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.224656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224496    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.224656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224576    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.224656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224640    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.224656 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.224657    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.325991 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.325948    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vpf\" (UniqueName: \"kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326002    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326072    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326152    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326174    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326232    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326483 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326427    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326608    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.326764 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.326677    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.328552 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.328522    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.328841 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.328820    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.334317 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.334298    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vpf\" (UniqueName: \"kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf\") pod \"sub-test-model-bb462a-kserve-6577ff7b85-hpv4l\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") " pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.478867 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.478769    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:55:50.622693 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:50.622652    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:55:50.625965 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:55:50.625904    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff6567ae_d736_4afa_bf6a_85b8815dd6e7.slice/crio-81de9b916d12edc76dbfbddf27c92b4c35a646a377c8260600b535570192ad77 WatchSource:0}: Error finding container 81de9b916d12edc76dbfbddf27c92b4c35a646a377c8260600b535570192ad77: Status 404 returned error can't find the container with id 81de9b916d12edc76dbfbddf27c92b4c35a646a377c8260600b535570192ad77
Jul 07 02:55:51.008048 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:51.008010    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" event={"ID":"ff6567ae-d736-4afa-bf6a-85b8815dd6e7","Type":"ContainerStarted","Data":"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"}
Jul 07 02:55:51.008208 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:51.008056    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" event={"ID":"ff6567ae-d736-4afa-bf6a-85b8815dd6e7","Type":"ContainerStarted","Data":"81de9b916d12edc76dbfbddf27c92b4c35a646a377c8260600b535570192ad77"}
Jul 07 02:55:51.024945 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:55:51.024879    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" podStartSLOduration=1.024864474 podStartE2EDuration="1.024864474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:55:51.023603383 +0000 UTC m=+2464.308458647" watchObservedRunningTime="2026-07-07 02:55:51.024864474 +0000 UTC m=+2464.309719734"
Jul 07 02:56:00.479252 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:56:00.479212    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:56:00.479252 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:56:00.479265    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:56:00.492080 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:56:00.492051    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:56:01.070116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:56:01.070085    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:56:53.924063 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:56:53.924021    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:57:05.740203 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.740158    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:57:05.742986 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.742960    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.744885 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.744860    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb462a\"/\"rate-test-model-bb462a-kserve-self-signed-certs\""
Jul 07 02:57:05.755616 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.755583    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:57:05.882266 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882226    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.882457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882275    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cf8g\" (UniqueName: \"kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.882457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882307    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.882457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882349    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.882457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882368    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.882457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.882432    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983750 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983706    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983783    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983821    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cf8g\" (UniqueName: \"kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983846    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983895    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.983996 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.983946    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.984392 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.984369    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.984490 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.984467    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.994649 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.984622    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.995310 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.995271    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.995763 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.995732    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:05.997420 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:05.997368    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cf8g\" (UniqueName: \"kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g\") pod \"rate-test-model-bb462a-kserve-764d9cb5f9-zb95p\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") " pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:06.054406 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:06.054367    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:06.200639 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:06.200614    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:57:06.202845 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:57:06.202815    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod779e3487_dd2e_4089_a750_954a44e688cc.slice/crio-7e6e20d37ac5478b2d748ab4a43eca67ffa09c43347b4af474b9c69cc4dfc194 WatchSource:0}: Error finding container 7e6e20d37ac5478b2d748ab4a43eca67ffa09c43347b4af474b9c69cc4dfc194: Status 404 returned error can't find the container with id 7e6e20d37ac5478b2d748ab4a43eca67ffa09c43347b4af474b9c69cc4dfc194
Jul 07 02:57:06.394935 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:06.394884    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" event={"ID":"779e3487-dd2e-4089-a750-954a44e688cc","Type":"ContainerStarted","Data":"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"}
Jul 07 02:57:06.395111 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:06.394957    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" event={"ID":"779e3487-dd2e-4089-a750-954a44e688cc","Type":"ContainerStarted","Data":"7e6e20d37ac5478b2d748ab4a43eca67ffa09c43347b4af474b9c69cc4dfc194"}
Jul 07 02:57:06.411548 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:06.411495    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" podStartSLOduration=1.411476354 podStartE2EDuration="1.411476354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:57:06.410022449 +0000 UTC m=+2539.694877712" watchObservedRunningTime="2026-07-07 02:57:06.411476354 +0000 UTC m=+2539.696331649"
Jul 07 02:57:08.945663 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:08.945626    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" podUID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" containerName="main" containerID="cri-o://33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5" gracePeriod=45
Jul 07 02:57:09.204347 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.204282    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:57:09.318002 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.317965    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318199 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318040    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318199 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318075    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7vpf\" (UniqueName: \"kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318199 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318133    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318199 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318193    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318411 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318217    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home\") pod \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\" (UID: \"ff6567ae-d736-4afa-bf6a-85b8815dd6e7\") "
Jul 07 02:57:09.318411 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318304    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:57:09.318575 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318497    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:57:09.318575 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318518    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home" (OuterVolumeSpecName: "home") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:57:09.318786 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318668    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.318786 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318686    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.318786 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.318699    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.320492 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.320467    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm" (OuterVolumeSpecName: "dshm") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:57:09.320593 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.320529    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:57:09.320659 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.320601    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf" (OuterVolumeSpecName: "kube-api-access-s7vpf") pod "ff6567ae-d736-4afa-bf6a-85b8815dd6e7" (UID: "ff6567ae-d736-4afa-bf6a-85b8815dd6e7"). InnerVolumeSpecName "kube-api-access-s7vpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:57:09.412639 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.412599    2545 generic.go:356] "Generic (PLEG): container finished" podID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" containerID="33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5" exitCode=0
Jul 07 02:57:09.412639 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.412641    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"
Jul 07 02:57:09.412857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.412685    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" event={"ID":"ff6567ae-d736-4afa-bf6a-85b8815dd6e7","Type":"ContainerDied","Data":"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"}
Jul 07 02:57:09.412857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.412727    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l" event={"ID":"ff6567ae-d736-4afa-bf6a-85b8815dd6e7","Type":"ContainerDied","Data":"81de9b916d12edc76dbfbddf27c92b4c35a646a377c8260600b535570192ad77"}
Jul 07 02:57:09.412857 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.412749    2545 scope.go:117] "RemoveContainer" containerID="33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"
Jul 07 02:57:09.420294 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.420263    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.420294 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.420291    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7vpf\" (UniqueName: \"kubernetes.io/projected/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-kube-api-access-s7vpf\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.420455 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.420304    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6567ae-d736-4afa-bf6a-85b8815dd6e7-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:57:09.422633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.422617    2545 scope.go:117] "RemoveContainer" containerID="33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"
Jul 07 02:57:09.422976 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:57:09.422948    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5\": container with ID starting with 33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5 not found: ID does not exist" containerID="33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"
Jul 07 02:57:09.423072 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.422983    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5"} err="failed to get container status \"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5\": rpc error: code = NotFound desc = could not find container \"33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5\": container with ID starting with 33599d108ac945b5c60fa420020cee0fcf0c378e6e545daeb931457af8eabdf5 not found: ID does not exist"
Jul 07 02:57:09.434665 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.434635    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:57:09.438412 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:09.438385    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/sub-test-model-bb462a-kserve-6577ff7b85-hpv4l"]
Jul 07 02:57:11.260061 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:11.260016    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" path="/var/lib/kubelet/pods/ff6567ae-d736-4afa-bf6a-85b8815dd6e7/volumes"
Jul 07 02:57:16.055317 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:16.055286    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:16.057802 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:16.055333    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:16.068199 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:16.068173    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:57:16.459633 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:57:16.459545    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:58:26.079360 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:26.078307    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:58:41.100966 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.100876    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" podUID="779e3487-dd2e-4089-a750-954a44e688cc" containerName="main" containerID="cri-o://39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728" gracePeriod=45
Jul 07 02:58:41.359943 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.359855    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:58:41.434142 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.434111    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.434348 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.434199    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.434423 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.434383    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:58:41.434506 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.434483    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache" (OuterVolumeSpecName: "model-cache") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:58:41.534884 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.534844    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cf8g\" (UniqueName: \"kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.535125 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.534895    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.535125 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.534959    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.535125 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.535076    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm\") pod \"779e3487-dd2e-4089-a750-954a44e688cc\" (UID: \"779e3487-dd2e-4089-a750-954a44e688cc\") "
Jul 07 02:58:41.535296 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.535240    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home" (OuterVolumeSpecName: "home") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:58:41.535458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.535442    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-model-cache\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.535504 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.535465    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-home\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.535504 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.535478    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-tmp-dir\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.537339 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.537312    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:58:41.537339 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.537322    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g" (OuterVolumeSpecName: "kube-api-access-5cf8g") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "kube-api-access-5cf8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:58:41.537339 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.537315    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm" (OuterVolumeSpecName: "dshm") pod "779e3487-dd2e-4089-a750-954a44e688cc" (UID: "779e3487-dd2e-4089-a750-954a44e688cc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:58:41.636879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.636787    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cf8g\" (UniqueName: \"kubernetes.io/projected/779e3487-dd2e-4089-a750-954a44e688cc-kube-api-access-5cf8g\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.636879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.636822    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779e3487-dd2e-4089-a750-954a44e688cc-tls-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.636879 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.636832    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779e3487-dd2e-4089-a750-954a44e688cc-dshm\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:58:41.890586 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.890487    2545 generic.go:356] "Generic (PLEG): container finished" podID="779e3487-dd2e-4089-a750-954a44e688cc" containerID="39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728" exitCode=0
Jul 07 02:58:41.890586 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.890542    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"
Jul 07 02:58:41.890586 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.890562    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" event={"ID":"779e3487-dd2e-4089-a750-954a44e688cc","Type":"ContainerDied","Data":"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"}
Jul 07 02:58:41.890864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.890596    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p" event={"ID":"779e3487-dd2e-4089-a750-954a44e688cc","Type":"ContainerDied","Data":"7e6e20d37ac5478b2d748ab4a43eca67ffa09c43347b4af474b9c69cc4dfc194"}
Jul 07 02:58:41.890864 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.890613    2545 scope.go:117] "RemoveContainer" containerID="39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"
Jul 07 02:58:41.900662 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.900644    2545 scope.go:117] "RemoveContainer" containerID="39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"
Jul 07 02:58:41.900995 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:58:41.900973    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728\": container with ID starting with 39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728 not found: ID does not exist" containerID="39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"
Jul 07 02:58:41.901074 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.901004    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728"} err="failed to get container status \"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728\": rpc error: code = NotFound desc = could not find container \"39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728\": container with ID starting with 39651e1a3a596eefd4cbec0ce94c6472840771e7d994805e0b52f382f2fa1728 not found: ID does not exist"
Jul 07 02:58:41.910993 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.910964    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:58:41.913365 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:41.913342    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb462a/rate-test-model-bb462a-kserve-764d9cb5f9-zb95p"]
Jul 07 02:58:43.259744 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:58:43.259714    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779e3487-dd2e-4089-a750-954a44e688cc" path="/var/lib/kubelet/pods/779e3487-dd2e-4089-a750-954a44e688cc/volumes"
Jul 07 02:59:17.608299 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:17.608261    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:59:17.608958 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:17.608540    2545 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy" containerID="cri-o://c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960" gracePeriod=30
Jul 07 02:59:20.917378 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:20.917341    2545 patch_prober.go:28] interesting pod/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:59:20.917771 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:20.917402    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:59:22.769437 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.769406    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dktrj_f0a518e4-031d-4cfd-9919-59ba02b7e6a0/manager/0.log"
Jul 07 02:59:22.873417 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.873348    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:59:22.892995 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.892960    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7ndd5_23179b3a-5c94-448c-9610-186923ae148b/manager/0.log"
Jul 07 02:59:22.948850 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948816    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.948850 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948856    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948883    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948946    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948971    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.948994    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949022    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949085    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r78zb\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949116 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949105    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy\") pod \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\" (UID: \"b47bfd2d-b0b7-4440-83b0-c31d0565638d\") "
Jul 07 02:59:22.949441 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949188    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:22.949441 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949202    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:22.949545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949449    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-certs\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:22.949545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949469    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-credential-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:22.949545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949466    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:22.949545 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.949505    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:59:22.950172 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.950024    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:22.951589 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.951556    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:59:22.951703 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.951606    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:59:22.951703 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.951650    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb" (OuterVolumeSpecName: "kube-api-access-r78zb") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "kube-api-access-r78zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:59:22.951703 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:22.951680    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b47bfd2d-b0b7-4440-83b0-c31d0565638d" (UID: "b47bfd2d-b0b7-4440-83b0-c31d0565638d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:23.050806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050770    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-workload-socket\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.050806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050802    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istiod-ca-cert\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.050806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050811    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-data\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.050806 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050819    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-token\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.051108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050827    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-podinfo\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.051108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050835    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r78zb\" (UniqueName: \"kubernetes.io/projected/b47bfd2d-b0b7-4440-83b0-c31d0565638d-kube-api-access-r78zb\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.051108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.050844    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b47bfd2d-b0b7-4440-83b0-c31d0565638d-istio-envoy\") on node \"ip-10-0-137-16.ec2.internal\" DevicePath \"\""
Jul 07 02:59:23.107259 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.107225    2545 generic.go:356] "Generic (PLEG): container finished" podID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerID="c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960" exitCode=0
Jul 07 02:59:23.107458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.107281    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"
Jul 07 02:59:23.107458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.107307    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerDied","Data":"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"}
Jul 07 02:59:23.107458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.107370    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2" event={"ID":"b47bfd2d-b0b7-4440-83b0-c31d0565638d","Type":"ContainerDied","Data":"1f97e8c4ae5f57d8b5134094dc445984a0d203a73a31e459737dc07262ffa0a7"}
Jul 07 02:59:23.107458 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.107406    2545 scope.go:117] "RemoveContainer" containerID="c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"
Jul 07 02:59:23.117303 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.117286    2545 scope.go:117] "RemoveContainer" containerID="c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"
Jul 07 02:59:23.131302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.131237    2545 scope.go:117] "RemoveContainer" containerID="c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"
Jul 07 02:59:23.131302 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.131274    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:59:23.131844 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:59:23.131790    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960\": container with ID starting with c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960 not found: ID does not exist" containerID="c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"
Jul 07 02:59:23.131844 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.131828    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960"} err="failed to get container status \"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960\": rpc error: code = NotFound desc = could not find container \"c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960\": container with ID starting with c82875d8c03dd197598a7e2ee23de9eb253e2893f858b0934536f4d165b28960 not found: ID does not exist"
Jul 07 02:59:23.132105 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.131873    2545 scope.go:117] "RemoveContainer" containerID="c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"
Jul 07 02:59:23.132300 ip-10-0-137-16 kubenswrapper[2545]: E0707 02:59:23.132271    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5\": container with ID starting with c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5 not found: ID does not exist" containerID="c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"
Jul 07 02:59:23.132394 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.132307    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5"} err="failed to get container status \"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5\": rpc error: code = NotFound desc = could not find container \"c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5\": container with ID starting with c8f8a99ab678188d91f02e47fc7f06f649efdecdc5469b2879d7746d788c5bd5 not found: ID does not exist"
Jul 07 02:59:23.133931 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.133895    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-890bdd-openshift-default-585cf959bc-wzfh2"]
Jul 07 02:59:23.259273 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.259242    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" path="/var/lib/kubelet/pods/b47bfd2d-b0b7-4440-83b0-c31d0565638d/volumes"
Jul 07 02:59:23.720250 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.720222    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-4cmqg_acaf9c23-89df-4cd9-966d-ef470d30cb06/copy-manifests/0.log"
Jul 07 02:59:23.727732 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:23.727701    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-4cmqg_acaf9c23-89df-4cd9-966d-ef470d30cb06/manager/0.log"
Jul 07 02:59:26.545542 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:26.545494    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47gfqr_4a2509d8-c00e-4b99-befc-f7dee1b6b5d5/istio-proxy/0.log"
Jul 07 02:59:26.903237 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:26.903154    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-k9zl9_9b60126f-ec33-4b54-b6c9-bc6c39f5b0df/kube-auth-proxy/0.log"
Jul 07 02:59:27.369969 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:27.369936    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-688bb557ff-hjz8t_e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514/router/0.log"
Jul 07 02:59:27.954363 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:27.954338    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dvq68_aeee70fa-2cb9-4bfb-95d5-a4fe6c48ab92/main/0.log"
Jul 07 02:59:28.070060 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:28.070029    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbldjwb_e6ff155b-be3e-49a7-b838-5a048e705d91/main/0.log"
Jul 07 02:59:28.295154 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:28.295125    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-4m89n_0ff3f2b1-3c49-4f19-ada0-06bbe991c653/main/0.log"
Jul 07 02:59:35.701292 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:35.701259    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5g2xh_f99f9e07-bfaf-436e-91c3-b0a6e03d85b6/global-pull-secret-syncer/0.log"
Jul 07 02:59:35.916304 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:35.916258    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r64rk_acab54ba-381a-4b30-9716-06a1f03336c0/konnectivity-agent/0.log"
Jul 07 02:59:35.967221 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:35.967143    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-16.ec2.internal_b5fc099c7007974686ef1fc33ec7465c/haproxy/0.log"
Jul 07 02:59:42.821794 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.821766    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/alertmanager/0.log"
Jul 07 02:59:42.856213 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.856186    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/config-reloader/0.log"
Jul 07 02:59:42.882382 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.882323    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/kube-rbac-proxy-web/0.log"
Jul 07 02:59:42.906963 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.906937    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/kube-rbac-proxy/0.log"
Jul 07 02:59:42.930582 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.930559    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/kube-rbac-proxy-metric/0.log"
Jul 07 02:59:42.955771 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.955743    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/prom-label-proxy/0.log"
Jul 07 02:59:42.980826 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:42.980743    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee5edcac-88a3-4ccb-bd84-01c5d361f3e9/init-config-reloader/0.log"
Jul 07 02:59:43.072422 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.072393    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-5n926_f256face-7ce4-4c80-9edf-2982029eb94c/kube-state-metrics/0.log"
Jul 07 02:59:43.105732 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.105708    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-5n926_f256face-7ce4-4c80-9edf-2982029eb94c/kube-rbac-proxy-main/0.log"
Jul 07 02:59:43.146075 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.146044    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-5n926_f256face-7ce4-4c80-9edf-2982029eb94c/kube-rbac-proxy-self/0.log"
Jul 07 02:59:43.282380 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.282301    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dkr6_b6fa1daa-76f0-4e9a-af48-bfacfbee79ce/node-exporter/0.log"
Jul 07 02:59:43.314108 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.314079    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dkr6_b6fa1daa-76f0-4e9a-af48-bfacfbee79ce/kube-rbac-proxy/0.log"
Jul 07 02:59:43.337852 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.337825    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dkr6_b6fa1daa-76f0-4e9a-af48-bfacfbee79ce/init-textfile/0.log"
Jul 07 02:59:43.564794 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.564767    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d2ncs_2d1a3717-77ca-47f8-8053-b7cd59ff6aef/kube-rbac-proxy-main/0.log"
Jul 07 02:59:43.589563 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.589530    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d2ncs_2d1a3717-77ca-47f8-8053-b7cd59ff6aef/kube-rbac-proxy-self/0.log"
Jul 07 02:59:43.613353 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.613325    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d2ncs_2d1a3717-77ca-47f8-8053-b7cd59ff6aef/openshift-state-metrics/0.log"
Jul 07 02:59:43.662148 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.662125    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/prometheus/0.log"
Jul 07 02:59:43.690043 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.690019    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/config-reloader/0.log"
Jul 07 02:59:43.716219 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.716193    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/thanos-sidecar/0.log"
Jul 07 02:59:43.746273 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.746243    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/kube-rbac-proxy-web/0.log"
Jul 07 02:59:43.769617 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.769592    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/kube-rbac-proxy/0.log"
Jul 07 02:59:43.796095 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.796066    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/kube-rbac-proxy-thanos/0.log"
Jul 07 02:59:43.819946 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.819838    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e42ed4b3-49fd-480a-b97c-220ee8f458dc/init-config-reloader/0.log"
Jul 07 02:59:43.903455 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:43.903431    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-k24tj_cef667f3-30b1-4df7-8205-163213fccee0/prometheus-operator-admission-webhook/0.log"
Jul 07 02:59:44.019628 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.019603    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/thanos-query/0.log"
Jul 07 02:59:44.043103 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.043076    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/kube-rbac-proxy-web/0.log"
Jul 07 02:59:44.071911 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.071841    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/kube-rbac-proxy/0.log"
Jul 07 02:59:44.099041 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.099017    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/prom-label-proxy/0.log"
Jul 07 02:59:44.124815 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.124787    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/kube-rbac-proxy-rules/0.log"
Jul 07 02:59:44.156982 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:44.156947    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99c8f66bc-mrdns_2f24f525-81db-4dfe-9b90-b03e5e718ea2/kube-rbac-proxy-metrics/0.log"
Jul 07 02:59:46.151120 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151084    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"]
Jul 07 02:59:46.151520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151493    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy"
Jul 07 02:59:46.151520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151505    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy"
Jul 07 02:59:46.151520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151514    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy"
Jul 07 02:59:46.151520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151519    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151528    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" containerName="main"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151534    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" containerName="main"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151542    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779e3487-dd2e-4089-a750-954a44e688cc" containerName="main"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151547    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="779e3487-dd2e-4089-a750-954a44e688cc" containerName="main"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151616    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b47bfd2d-b0b7-4440-83b0-c31d0565638d" containerName="istio-proxy"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151626    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff6567ae-d736-4afa-bf6a-85b8815dd6e7" containerName="main"
Jul 07 02:59:46.151654 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.151631    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="779e3487-dd2e-4089-a750-954a44e688cc" containerName="main"
Jul 07 02:59:46.154515 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.154492    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.156520 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.156497    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"openshift-service-ca.crt\""
Jul 07 02:59:46.156707 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.156688    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"kube-root-ca.crt\""
Jul 07 02:59:46.157070 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.157055    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wtppw\"/\"default-dockercfg-npm2w\""
Jul 07 02:59:46.165457 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.165431    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"]
Jul 07 02:59:46.274772 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.274737    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-proc\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.275042 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.274803    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2d7r\" (UniqueName: \"kubernetes.io/projected/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-kube-api-access-f2d7r\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.275042 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.274965    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-podres\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.275162 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.275044    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-sys\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.275162 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.275088    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-lib-modules\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.375824 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375775    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-podres\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375834    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-sys\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375863    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-lib-modules\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375893    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-proc\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375957    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2d7r\" (UniqueName: \"kubernetes.io/projected/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-kube-api-access-f2d7r\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375984    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-podres\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376030 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.375993    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-sys\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376247 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.376029    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-proc\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.376247 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.376073    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-lib-modules\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.383903 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.383867    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2d7r\" (UniqueName: \"kubernetes.io/projected/fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8-kube-api-access-f2d7r\") pod \"perf-node-gather-daemonset-xqt9m\" (UID: \"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.466196 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.466095    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:46.604604 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:46.604579    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"]
Jul 07 02:59:46.606765 ip-10-0-137-16 kubenswrapper[2545]: W0707 02:59:46.606737    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc474f43_c1a2_44a0_8d86_9f0ff15d5fd8.slice/crio-12fe8a04b1ccca2f9075c444cee883f5ed65eedd39f44c40fb7e32c6cae4c60c WatchSource:0}: Error finding container 12fe8a04b1ccca2f9075c444cee883f5ed65eedd39f44c40fb7e32c6cae4c60c: Status 404 returned error can't find the container with id 12fe8a04b1ccca2f9075c444cee883f5ed65eedd39f44c40fb7e32c6cae4c60c
Jul 07 02:59:47.239956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:47.239885    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m" event={"ID":"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8","Type":"ContainerStarted","Data":"b274dbe7d54c010a6f7aa1f86fbcd04f33425ba8d56b8b6a217cde0c45867112"}
Jul 07 02:59:47.239956 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:47.239961    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m" event={"ID":"fc474f43-c1a2-44a0-8d86-9f0ff15d5fd8","Type":"ContainerStarted","Data":"12fe8a04b1ccca2f9075c444cee883f5ed65eedd39f44c40fb7e32c6cae4c60c"}
Jul 07 02:59:47.240416 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:47.239996    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:47.255493 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:47.255429    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m" podStartSLOduration=1.2554077590000001 podStartE2EDuration="1.255407759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:59:47.25431246 +0000 UTC m=+2700.539167722" watchObservedRunningTime="2026-07-07 02:59:47.255407759 +0000 UTC m=+2700.540263021"
Jul 07 02:59:48.558289 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:48.558258    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhqvq_0aef31f0-20ee-4f9c-853f-5998579dc0c6/dns/0.log"
Jul 07 02:59:48.583271 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:48.583244    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhqvq_0aef31f0-20ee-4f9c-853f-5998579dc0c6/kube-rbac-proxy/0.log"
Jul 07 02:59:48.636622 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:48.636591    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxxz7_2b72273f-bfd0-4091-86fe-aa32631c8311/dns-node-resolver/0.log"
Jul 07 02:59:49.280653 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:49.280617    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdzq5_523c938d-deb8-4c9c-b68f-af401372c576/node-ca/0.log"
Jul 07 02:59:50.307619 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:50.307586    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47gfqr_4a2509d8-c00e-4b99-befc-f7dee1b6b5d5/istio-proxy/0.log"
Jul 07 02:59:50.487067 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:50.487034    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-k9zl9_9b60126f-ec33-4b54-b6c9-bc6c39f5b0df/kube-auth-proxy/0.log"
Jul 07 02:59:50.691622 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:50.691534    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-688bb557ff-hjz8t_e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514/router/0.log"
Jul 07 02:59:51.417281 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:51.417252    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b6gst_7b643258-d8d2-47db-9d4f-a9500678120f/serve-healthcheck-canary/0.log"
Jul 07 02:59:51.975257 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:51.975225    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-x9lf8_bef91ec5-453d-4036-8326-53ba11b6d928/insights-operator/0.log"
Jul 07 02:59:51.976911 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:51.976889    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-x9lf8_bef91ec5-453d-4036-8326-53ba11b6d928/insights-operator/1.log"
Jul 07 02:59:52.083429 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:52.083402    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn8ms_63fa2bec-6fff-46f0-899a-c52dfba71026/kube-rbac-proxy/0.log"
Jul 07 02:59:52.109329 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:52.109295    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn8ms_63fa2bec-6fff-46f0-899a-c52dfba71026/exporter/0.log"
Jul 07 02:59:52.132745 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:52.132707    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn8ms_63fa2bec-6fff-46f0-899a-c52dfba71026/extractor/0.log"
Jul 07 02:59:53.259210 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:53.259183    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-xqt9m"
Jul 07 02:59:54.562641 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:54.562613    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dktrj_f0a518e4-031d-4cfd-9919-59ba02b7e6a0/manager/0.log"
Jul 07 02:59:54.699356 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:54.699327    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7ndd5_23179b3a-5c94-448c-9610-186923ae148b/manager/0.log"
Jul 07 02:59:55.036984 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:55.036887    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-4cmqg_acaf9c23-89df-4cd9-966d-ef470d30cb06/manager/0.log"
Jul 07 02:59:55.063128 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:55.063094    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-4cmqg_acaf9c23-89df-4cd9-966d-ef470d30cb06/copy-manifests/0.log"
Jul 07 02:59:56.785516 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:56.785430    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb48ccbfc-2mvdz_260b1f2e-6bbc-4bd1-b202-b22df8d451b9/manager/0.log"
Jul 07 02:59:57.162904 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:57.162873    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47gfqr_4a2509d8-c00e-4b99-befc-f7dee1b6b5d5/istio-proxy/0.log"
Jul 07 02:59:57.317783 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:57.317754    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-k9zl9_9b60126f-ec33-4b54-b6c9-bc6c39f5b0df/kube-auth-proxy/0.log"
Jul 07 02:59:57.477255 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:57.477169    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-688bb557ff-hjz8t_e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514/router/0.log"
Jul 07 02:59:58.716542 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:58.716515    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47gfqr_4a2509d8-c00e-4b99-befc-f7dee1b6b5d5/istio-proxy/0.log"
Jul 07 02:59:58.863070 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:58.863041    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-k9zl9_9b60126f-ec33-4b54-b6c9-bc6c39f5b0df/kube-auth-proxy/0.log"
Jul 07 02:59:59.002527 ip-10-0-137-16 kubenswrapper[2545]: I0707 02:59:59.002449    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-688bb557ff-hjz8t_e35fb5e8-0b47-4f50-ad1e-5b5fea3f8514/router/0.log"
Jul 07 03:00:02.533825 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:02.533744    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-95gh9_ebe98e6e-062b-456d-8f26-7636c1597043/kube-storage-version-migrator-operator/1.log"
Jul 07 03:00:02.534478 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:02.534461    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-95gh9_ebe98e6e-062b-456d-8f26-7636c1597043/kube-storage-version-migrator-operator/0.log"
Jul 07 03:00:03.921344 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:03.921309    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smm6b_22ce5b0c-4e82-44ab-bfba-c4d228197060/kube-multus-additional-cni-plugins/0.log"
Jul 07 03:00:03.945070 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:03.945043    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smm6b_22ce5b0c-4e82-44ab-bfba-c4d228197060/egress-router-binary-copy/0.log"
Jul 07 03:00:03.968380 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:03.968351    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smm6b_22ce5b0c-4e82-44ab-bfba-c4d228197060/cni-plugins/0.log"
Jul 07 03:00:03.992376 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:03.992344    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smm6b_22ce5b0c-4e82-44ab-bfba-c4d228197060/bond-cni-plugin/0.log"
Jul 07 03:00:04.016189 ip-10-0-137-16 kubenswrapper[2545]: I0707 03:00:04.016164    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smm6b_22ce5b0c-4e82-44ab-bfba-c4d228197060/routeoverride-cni/0.log"