Jun 09 02:20:02.430153 ip-10-0-128-73 systemd[1]: Starting Kubernetes Kubelet...
Jun 09 02:20:02.821735 ip-10-0-128-73 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 02:20:02.821735 ip-10-0-128-73 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 09 02:20:02.821735 ip-10-0-128-73 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 02:20:02.821735 ip-10-0-128-73 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 09 02:20:02.821735 ip-10-0-128-73 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 02:20:02.824584 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.824502    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 09 02:20:02.830268 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830253    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.830268 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830268    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830271    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830275    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830278    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830280    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830283    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830286    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830289    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830292    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830295    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830297    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830301    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830313    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830317    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830320    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830323    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830326    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830329    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830331    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.830333 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830335    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830339    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830342    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830345    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830348    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830350    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830353    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830355    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830358    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830360    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830362    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830366    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830369    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830371    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830373    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830376    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830378    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830381    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830383    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830386    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.830774 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830388    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830391    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830393    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830396    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830398    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830401    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830403    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830406    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830408    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830411    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830413    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830415    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830419    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830421    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830424    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830428    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830430    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830433    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830435    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.831276 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830438    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830440    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830443    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830445    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830448    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830450    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830453    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830455    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830458    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830460    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830462    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830465    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830467    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830470    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830472    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830475    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830477    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830479    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830482    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830484    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.831716 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830486    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830489    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830492    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830494    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830497    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830499    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830501    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830504    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830507    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830510    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830512    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830515    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830517    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830520    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830522    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830524    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830527    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830529    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830533    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.830536    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.832198 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831210    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831217    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831220    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831223    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831225    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831228    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831231    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831234    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831237    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831239    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831242    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831245    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831247    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831250    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831252    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831255    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831257    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831260    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831262    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831266    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.832664 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831269    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831271    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831273    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831276    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831279    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831281    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831284    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831286    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831289    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831291    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831296    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831299    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831302    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831305    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831308    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831311    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831314    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831318    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831320    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831324    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.833162 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831327    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831330    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831333    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831335    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831338    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831340    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831343    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831347    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831350    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831354    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831356    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831360    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831363    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831365    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831368    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831370    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831373    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831376    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831380    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.833662 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831384    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831386    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831389    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831392    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831394    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831397    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831399    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831402    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831404    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831407    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831409    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831412    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831414    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831417    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831419    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831422    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831424    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831427    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831429    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831432    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.834130 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831435    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831438    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831441    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831443    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831446    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831448    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831450    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831453    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831455    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831458    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831460    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831463    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831465    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831482    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831486    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831489    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831491    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831494    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831497    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.831500    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.834613 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832208    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832214    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832216    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832219    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832222    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832225    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832228    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832230    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832233    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832236    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832239    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832242    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832244    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832247    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832249    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832252    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832254    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832256    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832261    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832264    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.835140 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832266    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832269    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832271    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832274    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832276    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832279    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832281    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832283    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832286    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832289    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832291    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832294    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832296    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832298    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832301    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832303    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832306    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832308    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832310    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832313    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.835614 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832315    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832320    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832323    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832325    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832328    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832331    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832333    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832336    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832338    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832340    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832343    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832345    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832348    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832350    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832352    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832355    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832358    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832360    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832362    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.836116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832364    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832367    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832369    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832372    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832376    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832379    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832382    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832384    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832387    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832389    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832391    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832394    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832397    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832399    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832402    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832404    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832407    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832409    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832411    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.836622 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832414    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832417    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832419    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832423    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832425    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832428    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832430    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832433    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832436    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832440    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832442    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832445    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832448    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832451    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832454    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832457    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832459    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832462    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832464    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.837095 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.832467    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832532    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832538    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832544    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832550    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832556    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832562    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832567    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832574    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832577    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832580    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832584    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832587    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832590    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832592    2576 flags.go:64] FLAG: --cgroup-root=""
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832595    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832598    2576 flags.go:64] FLAG: --client-ca-file=""
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832601    2576 flags.go:64] FLAG: --cloud-provider="external"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832604    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832608    2576 flags.go:64] FLAG: --cluster-domain=""
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832610    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832614    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832616    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832620    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jun 09 02:20:02.837549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832623    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832627    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832630    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832633    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832636    2576 flags.go:64] FLAG: --contention-profiling="false"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832639    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832641    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832644    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832647    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832651    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832654    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832657    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832659    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832662    2576 flags.go:64] FLAG: --enable-server="true"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832665    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832674    2576 flags.go:64] FLAG: --event-burst="100"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832677    2576 flags.go:64] FLAG: --event-qps="50"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832680    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832683    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832686    2576 flags.go:64] FLAG: --eviction-hard=""
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832694    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832697    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832699    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832703    2576 flags.go:64] FLAG: --eviction-soft=""
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832706    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 09 02:20:02.838121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832709    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832711    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832714    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832717    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832720    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832723    2576 flags.go:64] FLAG: --feature-gates=""
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832726    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832732    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832734    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832738    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832741    2576 flags.go:64] FLAG: --healthz-port="10248"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832743    2576 flags.go:64] FLAG: --help="false"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832746    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-73.ec2.internal"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832749    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832752    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832755    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832758    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832761    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832764    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832767    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832770    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832773    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832776    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832780    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jun 09 02:20:02.838719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832783    2576 flags.go:64] FLAG: --kube-reserved=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832785    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832790    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832792    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832796    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832798    2576 flags.go:64] FLAG: --lock-file=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832801    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832804    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832807    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832812    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832814    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832817    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832820    2576 flags.go:64] FLAG: --logging-format="text"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832823    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832826    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832830    2576 flags.go:64] FLAG: --manifest-url=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832833    2576 flags.go:64] FLAG: --manifest-url-header=""
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832837    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832840    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832844    2576 flags.go:64] FLAG: --max-pods="110"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832847    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832850    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832853    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832856    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832859    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 09 02:20:02.839405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832861    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832864    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832871    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832874    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832877    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832880    2576 flags.go:64] FLAG: --pod-cidr=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832883    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832901    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832904    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832908    2576 flags.go:64] FLAG: --pods-per-core="0"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832911    2576 flags.go:64] FLAG: --port="10250"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832914    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832917    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d0f4a17468fa8fb9"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832920    2576 flags.go:64] FLAG: --qos-reserved=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832922    2576 flags.go:64] FLAG: --read-only-port="10255"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832925    2576 flags.go:64] FLAG: --register-node="true"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832928    2576 flags.go:64] FLAG: --register-with-taints=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832931    2576 flags.go:64] FLAG: --registry-burst="10"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832934    2576 flags.go:64] FLAG: --registry-qps="5"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832937    2576 flags.go:64] FLAG: --reserved-cpus=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832940    2576 flags.go:64] FLAG: --reserved-memory=""
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832943    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832946    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832950    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832953    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 09 02:20:02.840128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832956    2576 flags.go:64] FLAG: --runonce="false"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832958    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832961    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832964    2576 flags.go:64] FLAG: --seccomp-default="false"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832967    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832969    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832972    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832975    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832978    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832981    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832984    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832986    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832989    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832992    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832995    2576 flags.go:64] FLAG: --system-cgroups=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.832998    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833005    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833008    2576 flags.go:64] FLAG: --tls-cert-file=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833010    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833014    2576 flags.go:64] FLAG: --tls-min-version=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833016    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833019    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833022    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833024    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833027    2576 flags.go:64] FLAG: --v="2"
Jun 09 02:20:02.841019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833031    2576 flags.go:64] FLAG: --version="false"
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833034    2576 flags.go:64] FLAG: --vmodule=""
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833038    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833041    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833143    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833150    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833155    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833158    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833161    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833164    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833167    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833171    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833173    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833176    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833179    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833182    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833184    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833187    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833189    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.841627 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833191    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833194    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833197    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833199    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833203    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833206    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833208    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833211    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833213    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833215    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833218    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833220    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833223    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833225    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833228    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833230    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833232    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833235    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833239    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833241    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.842116 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833244    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833248    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833251    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833254    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833257    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833259    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833262    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833264    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833267    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833269    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833272    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833274    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833277    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833279    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833282    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833284    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833288    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833292    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833294    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833296    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.842595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833299    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833301    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833304    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833306    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833308    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833311    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833313    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833316    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833318    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833320    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833324    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833327    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833329    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833332    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833334    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833337    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833339    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833341    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833344    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833346    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.843097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833349    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833351    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833354    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833356    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833358    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833361    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833363    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833366    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833369    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833372    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833375    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833377    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833379    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833382    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833384    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833387    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833389    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833391    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833394    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.843570 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833396    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833399    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833401    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833406    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.833408    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.833417    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.841582    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.841597    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.841615    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.841625    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841680    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841685    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841688    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841691    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841694    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.844047 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841697    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841700    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841704    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841708    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841711    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841714    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841717    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841720    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841724    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841728    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841731    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841734    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841737    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841739    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841742    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841745    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841747    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841750    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841752    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.844423 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841755    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841757    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841760    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841762    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841766    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841769    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841771    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841774    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841776    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841779    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841781    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841784    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841786    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841789    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841791    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841794    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841796    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841799    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841801    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841804    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.844872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841806    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841808    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841811    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841813    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841816    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841819    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841821    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841825    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841828    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841831    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841834    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841836    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841839    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841842    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841844    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841847    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841849    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841852    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841854    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841857    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.845396 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841860    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841862    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841864    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841867    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841870    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841872    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841874    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841877    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841879    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841882    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841884    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841887    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841904    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841907    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841910    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841914    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841916    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841919    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841921    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.845886 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841924    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841926    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841929    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841931    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841934    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841936    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841939    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841941    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841944    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841946    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841949    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841951    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841954    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841957    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841959    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.846485 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.841961    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.841966    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842094    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842099    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842102    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842105    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842108    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842110    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842112    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842115    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842118    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842120    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842123    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842126    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842129    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 02:20:02.846867 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842132    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842135    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842137    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842140    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842142    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842145    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842148    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842150    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842152    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842155    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842157    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842160    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842162    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842164    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842167    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842170    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842172    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842174    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842177    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842179    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 02:20:02.847248 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842183    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842187    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842190    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842192    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842195    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842198    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842201    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842203    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842206    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842210    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842213    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842216    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842219    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842221    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842224    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842226    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842229    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842232    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842234    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 02:20:02.847717 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842236    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842239    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842241    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842243    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842246    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842248    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842251    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842253    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842256    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842258    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842261    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842264    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842266    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842269    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842271    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842273    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842276    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842278    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842281    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842283    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 02:20:02.848178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842286    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842288    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842290    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842293    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842295    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842298    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842300    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842303    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842305    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842308    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842310    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842313    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842315    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842317    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842320    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842322    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842324    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842327    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842329    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 02:20:02.848647 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842332    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842334    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842337    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842340    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842343    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842346    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842348    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:02.842352    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.842356    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.842460    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.844864    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.846632    2576 server.go:1019] "Starting client certificate rotation"
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.846728    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 02:20:02.849132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.846762    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 02:20:02.849491 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.849479    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 02:20:02.850631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.850613    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 02:20:02.861696 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.861676    2576 log.go:25] "Validated CRI v1 runtime API"
Jun 09 02:20:02.864936 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.864917    2576 log.go:25] "Validated CRI v1 image API"
Jun 09 02:20:02.865728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.865715    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 09 02:20:02.869015 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.868990    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 833170a3-e962-4c86-9b6e-75129e5b27a5:/dev/nvme0n1p4 933872d6-1c3b-4755-a101-254b8253a07e:/dev/nvme0n1p3]
Jun 09 02:20:02.869074 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.869014    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 09 02:20:02.873184 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.873163    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 02:20:02.875027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.874918    2576 manager.go:216] Machine: {Timestamp:2026-06-09 02:20:02.873444601 +0000 UTC m=+0.347566248 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3183001 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d70d02e7976699d33c61fa80a7333 SystemUUID:ec2d70d0-2e79-7669-9d33-c61fa80a7333 BootID:5d0aef27-4b26-449f-a2f7-0495b892baaa Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:a0:ea:eb:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:a0:ea:eb:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:a3:e1:79:31:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 09 02:20:02.875027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.875012    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 09 02:20:02.875176 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.875118    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 09 02:20:02.878577 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.878549    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 09 02:20:02.878761 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.878581    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 09 02:20:02.879434 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.879421    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jun 09 02:20:02.879498 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.879439    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jun 09 02:20:02.879498 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.879450    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 02:20:02.880298 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.880287    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 02:20:02.881497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.881485    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 09 02:20:02.885867 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.885854    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 02:20:02.886116 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.886097    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 09 02:20:02.886200 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.886185    2576 kubelet.go:486] "Attempting to sync node with API server"
Jun 09 02:20:02.886259 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.886220    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 09 02:20:02.887524 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.887504    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 09 02:20:02.887592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.887531    2576 kubelet.go:398] "Adding apiserver pod source"
Jun 09 02:20:02.887592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.887547    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 09 02:20:02.888115 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.888101    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 02:20:02.888163 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.888121    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 02:20:02.890507 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.890490    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 09 02:20:02.892174 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.892160    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 09 02:20:02.892232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.892189    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 09 02:20:02.893527 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893516    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893530    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893536    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893541    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893549    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893554    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893563    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 09 02:20:02.893566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893568    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 09 02:20:02.893738 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893574    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 09 02:20:02.893738 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893579    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 09 02:20:02.893738 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893587    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 09 02:20:02.893738 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.893593    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 09 02:20:02.894430 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.894421    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 09 02:20:02.894430 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.894430    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 09 02:20:02.896874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.896846    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w9gcn"
Jun 09 02:20:02.897518 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.897506    2576 server.go:1268] "Started kubelet"
Jun 09 02:20:02.897611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.897590    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 09 02:20:02.897698 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.897669    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 09 02:20:02.897761 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.897690    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 09 02:20:02.897957 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.897873    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 09 02:20:02.897957 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.897881    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 09 02:20:02.897957 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.897914    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 09 02:20:02.898402 ip-10-0-128-73 systemd[1]: Started Kubernetes Kubelet.
Jun 09 02:20:02.899909 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.899883    2576 server.go:310] "Adding debug handlers to kubelet server"
Jun 09 02:20:02.900034 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.900010    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 09 02:20:02.902483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.902468    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w9gcn"
Jun 09 02:20:02.905402 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.904270    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b7483ca1c31ff2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-09 02:20:02.897477618 +0000 UTC m=+0.371599264,LastTimestamp:2026-06-09 02:20:02.897477618 +0000 UTC m=+0.371599264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}"
Jun 09 02:20:02.905573 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.905558    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 09 02:20:02.907570 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.907551    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 09 02:20:02.907570 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.907568    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 09 02:20:02.907827 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.907794    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:02.908227 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.908209    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 09 02:20:02.908310 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.908242    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 09 02:20:02.908310 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.908257    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 09 02:20:02.908407 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.908362    2576 reconstruct.go:97] "Volume reconstruction finished"
Jun 09 02:20:02.908407 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.908374    2576 reconciler.go:29] "Reconciler: start to sync state"
Jun 09 02:20:02.910837 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.910807    2576 factory.go:55] Registering systemd factory
Jun 09 02:20:02.910837 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.910827    2576 factory.go:223] Registration of the systemd container factory successfully
Jun 09 02:20:02.911085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911066    2576 factory.go:153] Registering CRI-O factory
Jun 09 02:20:02.911085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911086    2576 factory.go:223] Registration of the crio container factory successfully
Jun 09 02:20:02.911231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911128    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 09 02:20:02.911231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911174    2576 factory.go:103] Registering Raw factory
Jun 09 02:20:02.911231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911196    2576 manager.go:1196] Started watching for new ooms in manager
Jun 09 02:20:02.911408 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.911384    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 09 02:20:02.911505 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.911469    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 09 02:20:02.911780 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.911767    2576 manager.go:349] Starting recovery of all containers
Jun 09 02:20:02.922312 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.922202    2576 manager.go:354] Recovery completed
Jun 09 02:20:02.926085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.926073    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:02.927803 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.927788    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:02.927870 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.927815    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:02.927870 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.927829    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:02.928276 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.928263    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 09 02:20:02.928276 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.928275    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 09 02:20:02.928383 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.928289    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 02:20:02.928383 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.928269    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:02.929028 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.929007    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:02.929072 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.929038    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:02.929072 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.929048    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:02.930416 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.930405    2576 policy_none.go:49] "None policy: Start"
Jun 09 02:20:02.930455 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.930420    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 09 02:20:02.930455 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.930430    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 09 02:20:02.932169 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.932159    2576 policy_none.go:47] "Start"
Jun 09 02:20:02.964435 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964420    2576 manager.go:337] "Starting Device Plugin manager"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.964449    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964458    2576 server.go:87] "Starting device plugin registration server"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964662    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964674    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964752    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964814    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.964822    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.965330    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.965375    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.974545    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.975642    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.975673    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.975699    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:02.975735    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 09 02:20:02.984018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:02.977550    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 02:20:03.065629 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.065605    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:03.066458 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.066443    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:03.066529 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.066473    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:03.066529 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.066488    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:03.066529 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.066521    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.074379 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.074324    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.074379 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.074348    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-73.ec2.internal\": node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.076222 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.076205    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"]
Jun 09 02:20:03.076274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.076265    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:03.078309 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.078291    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:03.078390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.078319    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:03.078390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.078329    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:03.080782 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.080770    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:03.080919 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.080886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.081006 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.080949    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:03.081537 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081522    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:03.081603 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081547    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:03.081603 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081557    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:03.081603 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081576    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:03.081736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081608    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:03.081736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.081624    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:03.084043 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.084024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.084122 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.084069    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 02:20:03.085199 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.085185    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 02:20:03.085269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.085207    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 02:20:03.085269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.085216    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 02:20:03.087949 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.087911    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.110163 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.110145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.110241 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.110167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.110241 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.110189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.118274 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.118257    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.121631 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.121616    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.188282 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.188263    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.211083 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.211181 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.211181 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.211181 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.211181 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211153    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.211181 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.211173    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.289239 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.289220    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.389967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.389878    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.425390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.425356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.428520 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.428501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:03.491030 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.491003    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.591574 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.591550    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.692088 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.692024    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.792593 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.792564    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.846027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.845992    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 09 02:20:03.846516 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.846159    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 02:20:03.893509 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.893485    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:03.910316 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.910286    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 02:15:02 +0000 UTC" deadline="2027-12-12 08:27:32.799840434 +0000 UTC"
Jun 09 02:20:03.910316 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:03.910312    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13230h7m28.889531616s"
Jun 09 02:20:03.993937 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:03.993912    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 02:20:04.017586 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.017556    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 02:20:04.073806 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:04.073772    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58267d6e6471fb16c1b68a4f6cfaa490.slice/crio-e577e73b0505228280f4d60e69c2bf3403e73cf0bcc5e79d2fa4b2951b80b4a0 WatchSource:0}: Error finding container e577e73b0505228280f4d60e69c2bf3403e73cf0bcc5e79d2fa4b2951b80b4a0: Status 404 returned error can't find the container with id e577e73b0505228280f4d60e69c2bf3403e73cf0bcc5e79d2fa4b2951b80b4a0
Jun 09 02:20:04.074157 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:04.074134    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa226fc2d2c5f842f452b30ccab5b919.slice/crio-0597db027bed091db821b22ba8441ffdd6c4179aac6ef550d0ca417c828443a7 WatchSource:0}: Error finding container 0597db027bed091db821b22ba8441ffdd6c4179aac6ef550d0ca417c828443a7: Status 404 returned error can't find the container with id 0597db027bed091db821b22ba8441ffdd6c4179aac6ef550d0ca417c828443a7
Jun 09 02:20:04.079404 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.079388    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 02:20:04.108497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.108475    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:04.118771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.118753    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 02:20:04.120960 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.120946    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 02:20:04.130238 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.130225    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 02:20:04.251637 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.251570    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 02:20:04.500513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.500487    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 02:20:04.888723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.888690    2576 apiserver.go:52] "Watching apiserver"
Jun 09 02:20:04.897280 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.897256    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 09 02:20:04.897637 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.897611    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-758bx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal","openshift-multus/network-metrics-daemon-gnvkg","openshift-network-diagnostics/network-check-target-p4h2s","openshift-network-operator/iptables-alerter-nzzdh","openshift-ovn-kubernetes/ovnkube-node-sjhqc","kube-system/global-pull-secret-syncer-6hng4","kube-system/konnectivity-agent-7hq52","kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j","openshift-cluster-node-tuning-operator/tuned-dbhst","openshift-image-registry/node-ca-bx8ql","openshift-multus/multus-additional-cni-plugins-7pxd9","openshift-multus/multus-rmm89"]
Jun 09 02:20:04.900389 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.900357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:04.900502 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:04.900445    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:04.902628 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.902574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.904720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.904611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:04.904720 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:04.904687    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:04.905235 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905214    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g9dqp\""
Jun 09 02:20:04.905235 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905243    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 09 02:20:04.905733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905445    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.905733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.905733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905494    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 09 02:20:04.905733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.905525    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 09 02:20:04.906785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.906764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:04.906872 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:04.906827    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:04.908655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.908046    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 09 02:20:04.911426 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.911407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:04.913530 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.913507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:04.913869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.913843    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xcx7l\""
Jun 09 02:20:04.914076 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.914041    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 09 02:20:04.914163 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.914126    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.914296 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.914254    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.916155 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.915694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 09 02:20:04.916155 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.915840    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmm89"
Jun 09 02:20:04.916736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.916425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917443    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917444    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4nqj\""
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917522    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917454    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 09 02:20:04.917721 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917569    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.918057 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.917920    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 09 02:20:04.918214 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.918198    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lhbfv\""
Jun 09 02:20:04.918837 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.918417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-kubelet-config\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fmjz\""
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920640    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-dbus\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:04.920801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-system-cni-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-cnibin\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.920871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv9n2\" (UniqueName: \"kubernetes.io/projected/be7b16f6-1842-4335-a815-65c29230016a-kube-api-access-pv9n2\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56aa665-0403-4186-a1ff-e442ee8f222f-iptables-alerter-script\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:04.921373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56aa665-0403-4186-a1ff-e442ee8f222f-host-slash\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:04.921631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xvc\" (UniqueName: \"kubernetes.io/projected/a56aa665-0403-4186-a1ff-e442ee8f222f-kube-api-access-77xvc\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:04.921631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-os-release\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921631 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:04.921787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt2v9\" (UniqueName: \"kubernetes.io/projected/e70df090-e6a8-49c3-a22f-25e688e969a6-kube-api-access-pt2v9\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:04.921787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:04.922821 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.921961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:04.924915 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.924450    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 09 02:20:04.924999 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.924970    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8qkmm\""
Jun 09 02:20:04.925778 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.925415    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 09 02:20:04.927121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.927097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:04.929514 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.929154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:04.929514 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.929336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 09 02:20:04.929514 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.929368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.929794 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.929777    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.930023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.929993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5njtt\""
Jun 09 02:20:04.931653 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.931298    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.931653 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.931402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:04.931918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.931699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.932110 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.932063    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h5sqm\""
Jun 09 02:20:04.933730 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.933710    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 09 02:20:04.933844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.933827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-884s2\""
Jun 09 02:20:04.934238 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.934222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 09 02:20:04.934313 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.934297    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 09 02:20:04.936420 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.936399    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvx28"
Jun 09 02:20:04.943162 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.943141    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvx28"
Jun 09 02:20:04.980037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.979980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"e577e73b0505228280f4d60e69c2bf3403e73cf0bcc5e79d2fa4b2951b80b4a0"}
Jun 09 02:20:04.981223 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:04.981197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"0597db027bed091db821b22ba8441ffdd6c4179aac6ef550d0ca417c828443a7"}
Jun 09 02:20:05.009037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.009008    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 09 02:20:05.021954 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.021926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-systemd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.022082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.021959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.022082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.021986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-sys-fs\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.022082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5mnr\" (UniqueName: \"kubernetes.io/projected/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kube-api-access-h5mnr\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.022082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.022277 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028f4486-012b-42f5-827b-c85720a09d46-konnectivity-ca\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-modprobe-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56aa665-0403-4186-a1ff-e442ee8f222f-host-slash\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cnibin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-kubernetes\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-bin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-kubelet\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-os-release\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-systemd-units\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-var-lib-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.022954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-os-release\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56aa665-0403-4186-a1ff-e442ee8f222f-host-slash\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.023279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-socket-dir-parent\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-serviceca\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-dbus\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-slash\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-etc-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-ovn\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-system-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knpf\" (UniqueName: \"kubernetes.io/projected/15b79ddd-1050-43e2-889d-b7c7bec1d7be-kube-api-access-7knpf\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-device-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-multus\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-cnibin\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-host\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58hrv\" (UniqueName: \"kubernetes.io/projected/54c9087d-2e5c-4b37-a785-439ad99fa62e-kube-api-access-58hrv\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-host\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-netns\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.023866 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xvc\" (UniqueName: \"kubernetes.io/projected/a56aa665-0403-4186-a1ff-e442ee8f222f-kube-api-access-77xvc\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-env-overrides\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-conf-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-multus-certs\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-tmp\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.023972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-bin\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-netd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-etc-kubernetes\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-socket-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-sys\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-systemd\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv9n2\" (UniqueName: \"kubernetes.io/projected/be7b16f6-1842-4335-a815-65c29230016a-kube-api-access-pv9n2\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56aa665-0403-4186-a1ff-e442ee8f222f-iptables-alerter-script\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.024583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-kubelet\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26354ed2-3f22-48d7-8f95-3dabdefe0281-hosts-file\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6688\" (UniqueName: \"kubernetes.io/projected/26354ed2-3f22-48d7-8f95-3dabdefe0281-kube-api-access-r6688\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-hostroot\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-script-lib\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-var-lib-kubelet\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khdbg\" (UniqueName: \"kubernetes.io/projected/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-kube-api-access-khdbg\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-k8s-cni-cncf-io\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2v9\" (UniqueName: \"kubernetes.io/projected/e70df090-e6a8-49c3-a22f-25e688e969a6-kube-api-access-pt2v9\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-node-log\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnkq6\" (UniqueName: \"kubernetes.io/projected/0deea437-1482-4f29-95c5-0e51bc5ba2a4-kube-api-access-vnkq6\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-os-release\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.025323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-kubelet-config\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-config\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-daemon-config\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-registration-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysconfig\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-lib-modules\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-system-cni-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.024990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028f4486-012b-42f5-827b-c85720a09d46-agent-certs\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.025627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.025710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-system-cni-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.025966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.025870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.025980    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7b16f6-1842-4335-a815-65c29230016a-cnibin\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-dbus\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e83470f-9c46-4ede-a475-c42e413676ce-kubelet-config\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026264    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.026276    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:05.026465 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.026378    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:05.526330993 +0000 UTC m=+3.000452641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:05.026727 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026485    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.026727 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026576    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7b16f6-1842-4335-a815-65c29230016a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.026727 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.026655    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:05.026727 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-conf\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.026922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026700    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56aa665-0403-4186-a1ff-e442ee8f222f-iptables-alerter-script\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.026922 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.026761    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:05.526741562 +0000 UTC m=+3.000863225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:05.026922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.026810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-run\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.027220 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.027182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-netns\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.027327 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.027226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26354ed2-3f22-48d7-8f95-3dabdefe0281-tmp-dir\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.027327 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.027311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-tuned\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.027426 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.027347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-log-socket\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.027426 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.027381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cni-binary-copy\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.034682 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.034661    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:05.034682 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.034685    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:05.034824 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.034695    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:05.034824 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.034734    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:05.534724071 +0000 UTC m=+3.008845702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:05.034949 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.034881    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 09 02:20:05.038351 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.038332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2v9\" (UniqueName: \"kubernetes.io/projected/e70df090-e6a8-49c3-a22f-25e688e969a6-kube-api-access-pt2v9\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:05.038417 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.038367    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv9n2\" (UniqueName: \"kubernetes.io/projected/be7b16f6-1842-4335-a815-65c29230016a-kube-api-access-pv9n2\") pod \"multus-additional-cni-plugins-7pxd9\" (UID: \"be7b16f6-1842-4335-a815-65c29230016a\") " pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.038417 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.038332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xvc\" (UniqueName: \"kubernetes.io/projected/a56aa665-0403-4186-a1ff-e442ee8f222f-kube-api-access-77xvc\") pod \"iptables-alerter-nzzdh\" (UID: \"a56aa665-0403-4186-a1ff-e442ee8f222f\") " pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.128636 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-socket-dir-parent\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-serviceca\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-slash\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-etc-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-ovn\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-socket-dir-parent\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-system-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7knpf\" (UniqueName: \"kubernetes.io/projected/15b79ddd-1050-43e2-889d-b7c7bec1d7be-kube-api-access-7knpf\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-slash\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-ovn\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.128804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-device-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128780    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-etc-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-multus\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-system-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128849    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-device-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.128951    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-multus\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-host\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58hrv\" (UniqueName: \"kubernetes.io/projected/54c9087d-2e5c-4b37-a785-439ad99fa62e-kube-api-access-58hrv\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-host\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-host\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-serviceca\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-netns\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-env-overrides\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129162    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-netns\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-host\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-conf-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129221    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-conf-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.129301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-multus-certs\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-tmp\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-multus-certs\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-bin\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-netd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-etc-kubernetes\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-socket-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129434    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-netd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-sys\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-systemd\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-kubelet\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26354ed2-3f22-48d7-8f95-3dabdefe0281-hosts-file\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-etc-kubernetes\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6688\" (UniqueName: \"kubernetes.io/projected/26354ed2-3f22-48d7-8f95-3dabdefe0281-kube-api-access-r6688\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-hostroot\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129636    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-systemd\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129649    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-cni-bin\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26354ed2-3f22-48d7-8f95-3dabdefe0281-hosts-file\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-sys\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-script-lib\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129699    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-kubelet\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-env-overrides\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-var-lib-kubelet\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-hostroot\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129667    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-socket-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khdbg\" (UniqueName: \"kubernetes.io/projected/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-kube-api-access-khdbg\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-k8s-cni-cncf-io\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-var-lib-kubelet\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-node-log\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnkq6\" (UniqueName: \"kubernetes.io/projected/0deea437-1482-4f29-95c5-0e51bc5ba2a4-kube-api-access-vnkq6\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.130868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-run-k8s-cni-cncf-io\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-node-log\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-os-release\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.129972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130016    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-config\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-os-release\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-daemon-config\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-registration-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysconfig\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-registration-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-lib-modules\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130166    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysconfig\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028f4486-012b-42f5-827b-c85720a09d46-agent-certs\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-script-lib\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130253    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-cni-dir\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-conf\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.131716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-run\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-netns\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130278    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-lib-modules\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26354ed2-3f22-48d7-8f95-3dabdefe0281-tmp-dir\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130371    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-run\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-tuned\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-log-socket\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130445    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-sysctl-conf\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cni-binary-copy\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-systemd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovnkube-config\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130547    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-sys-fs\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-run-netns\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5mnr\" (UniqueName: \"kubernetes.io/projected/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kube-api-access-h5mnr\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26354ed2-3f22-48d7-8f95-3dabdefe0281-tmp-dir\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-run-systemd\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.132605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-multus-daemon-config\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028f4486-012b-42f5-827b-c85720a09d46-konnectivity-ca\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130663    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-sys-fs\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-modprobe-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cnibin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-log-socket\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-kubernetes\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-bin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-kubelet\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-systemd-units\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-var-lib-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130888    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cni-binary-copy\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-var-lib-openvswitch\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.130962    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-cnibin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-kubernetes\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131060    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-cni-bin\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.133446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131075    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-modprobe-d\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131102    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b79ddd-1050-43e2-889d-b7c7bec1d7be-host-var-lib-kubelet\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028f4486-012b-42f5-827b-c85720a09d46-konnectivity-ca\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.131124    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0deea437-1482-4f29-95c5-0e51bc5ba2a4-systemd-units\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.132736    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-tmp\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.132774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028f4486-012b-42f5-827b-c85720a09d46-agent-certs\") pod \"konnectivity-agent-7hq52\" (UID: \"028f4486-012b-42f5-827b-c85720a09d46\") " pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.133426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54c9087d-2e5c-4b37-a785-439ad99fa62e-etc-tuned\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.134012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.133520    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0deea437-1482-4f29-95c5-0e51bc5ba2a4-ovn-node-metrics-cert\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.137028 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.136984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knpf\" (UniqueName: \"kubernetes.io/projected/15b79ddd-1050-43e2-889d-b7c7bec1d7be-kube-api-access-7knpf\") pod \"multus-rmm89\" (UID: \"15b79ddd-1050-43e2-889d-b7c7bec1d7be\") " pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.137531 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.137493    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khdbg\" (UniqueName: \"kubernetes.io/projected/11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3-kube-api-access-khdbg\") pod \"node-ca-bx8ql\" (UID: \"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3\") " pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.138196 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.138115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58hrv\" (UniqueName: \"kubernetes.io/projected/54c9087d-2e5c-4b37-a785-439ad99fa62e-kube-api-access-58hrv\") pod \"tuned-dbhst\" (UID: \"54c9087d-2e5c-4b37-a785-439ad99fa62e\") " pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.138611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.138591    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6688\" (UniqueName: \"kubernetes.io/projected/26354ed2-3f22-48d7-8f95-3dabdefe0281-kube-api-access-r6688\") pod \"node-resolver-758bx\" (UID: \"26354ed2-3f22-48d7-8f95-3dabdefe0281\") " pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.138783 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.138736    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnkq6\" (UniqueName: \"kubernetes.io/projected/0deea437-1482-4f29-95c5-0e51bc5ba2a4-kube-api-access-vnkq6\") pod \"ovnkube-node-sjhqc\" (UID: \"0deea437-1482-4f29-95c5-0e51bc5ba2a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.138856 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.138842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5mnr\" (UniqueName: \"kubernetes.io/projected/8beaa7bf-674a-4825-bcd4-00c81ef3bfba-kube-api-access-h5mnr\") pod \"aws-ebs-csi-driver-node-mdf6j\" (UID: \"8beaa7bf-674a-4825-bcd4-00c81ef3bfba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.215404 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.215371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pxd9"
Jun 09 02:20:05.226904 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.226870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzzdh"
Jun 09 02:20:05.237846 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.237826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:05.241616 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.241597    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmm89"
Jun 09 02:20:05.249591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.249571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-758bx"
Jun 09 02:20:05.257173 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.257154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:05.263817 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.263797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j"
Jun 09 02:20:05.271515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.271495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbhst"
Jun 09 02:20:05.277961 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.277945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx8ql"
Jun 09 02:20:05.286603 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.286588    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 02:20:05.533862 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.533834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:05.534051 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.533932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.534051 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.534010    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:05.534051 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.534045    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:05.534176 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.534067    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:06.534053518 +0000 UTC m=+4.008175153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:05.534176 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.534091    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:06.534076826 +0000 UTC m=+4.008198473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:05.634671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.634636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:05.634819 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.634806    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:05.634863 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.634828    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:05.634863 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.634838    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:05.634946 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.634904    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:06.634872449 +0000 UTC m=+4.108994080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:05.902470 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.902443    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7b16f6_1842_4335_a815_65c29230016a.slice/crio-d4183d3de71da2df8ce60a2e68f9f981e8892cfbfc53c5eaac8b0c57cf6a3495 WatchSource:0}: Error finding container d4183d3de71da2df8ce60a2e68f9f981e8892cfbfc53c5eaac8b0c57cf6a3495: Status 404 returned error can't find the container with id d4183d3de71da2df8ce60a2e68f9f981e8892cfbfc53c5eaac8b0c57cf6a3495
Jun 09 02:20:05.922578 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.922548    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56aa665_0403_4186_a1ff_e442ee8f222f.slice/crio-2fde51caa47d39f39032d2cba5e353c25bcfbaab787660f6033c8a23e5fda980 WatchSource:0}: Error finding container 2fde51caa47d39f39032d2cba5e353c25bcfbaab787660f6033c8a23e5fda980: Status 404 returned error can't find the container with id 2fde51caa47d39f39032d2cba5e353c25bcfbaab787660f6033c8a23e5fda980
Jun 09 02:20:05.923215 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.923191    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b79ddd_1050_43e2_889d_b7c7bec1d7be.slice/crio-1e85fa2483591fd92da8b1152567d459d338988f1544cd667011ff292a7eeba5 WatchSource:0}: Error finding container 1e85fa2483591fd92da8b1152567d459d338988f1544cd667011ff292a7eeba5: Status 404 returned error can't find the container with id 1e85fa2483591fd92da8b1152567d459d338988f1544cd667011ff292a7eeba5
Jun 09 02:20:05.928391 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.928366    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0deea437_1482_4f29_95c5_0e51bc5ba2a4.slice/crio-826b137b7b5c1e447f0bedbbd473e7d7a53ec62801b5ab19e67fce36ffba6be7 WatchSource:0}: Error finding container 826b137b7b5c1e447f0bedbbd473e7d7a53ec62801b5ab19e67fce36ffba6be7: Status 404 returned error can't find the container with id 826b137b7b5c1e447f0bedbbd473e7d7a53ec62801b5ab19e67fce36ffba6be7
Jun 09 02:20:05.929750 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.929730    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8beaa7bf_674a_4825_bcd4_00c81ef3bfba.slice/crio-23c01d5d1675924d774b731ac96d898c3cee16983251e3fa0ba3d453389384dc WatchSource:0}: Error finding container 23c01d5d1675924d774b731ac96d898c3cee16983251e3fa0ba3d453389384dc: Status 404 returned error can't find the container with id 23c01d5d1675924d774b731ac96d898c3cee16983251e3fa0ba3d453389384dc
Jun 09 02:20:05.931412 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.931390    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028f4486_012b_42f5_827b_c85720a09d46.slice/crio-a6d0d1e59c6c6f0ac4f5c9a3da93112f62a3cad7e9e5f2ef66a69c4f15608685 WatchSource:0}: Error finding container a6d0d1e59c6c6f0ac4f5c9a3da93112f62a3cad7e9e5f2ef66a69c4f15608685: Status 404 returned error can't find the container with id a6d0d1e59c6c6f0ac4f5c9a3da93112f62a3cad7e9e5f2ef66a69c4f15608685
Jun 09 02:20:05.933056 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.933005    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26354ed2_3f22_48d7_8f95_3dabdefe0281.slice/crio-7145a967c8883aecbb21f1cfb8363a28b129c522feb3cf3bea716e9e66497085 WatchSource:0}: Error finding container 7145a967c8883aecbb21f1cfb8363a28b129c522feb3cf3bea716e9e66497085: Status 404 returned error can't find the container with id 7145a967c8883aecbb21f1cfb8363a28b129c522feb3cf3bea716e9e66497085
Jun 09 02:20:05.935438 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.935227    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c9087d_2e5c_4b37_a785_439ad99fa62e.slice/crio-6bb3318bc9e494f9b1b7c864590c08affe5459390efa4274db4c1dbc650c35de WatchSource:0}: Error finding container 6bb3318bc9e494f9b1b7c864590c08affe5459390efa4274db4c1dbc650c35de: Status 404 returned error can't find the container with id 6bb3318bc9e494f9b1b7c864590c08affe5459390efa4274db4c1dbc650c35de
Jun 09 02:20:05.935600 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:05.935479    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11589df6_dafd_4ce7_8ed8_d4ccfc8a0ba3.slice/crio-a1f46380a1c5037851a0766c3936c1c7a8fd7ff136bf2fb11b96491b485a75be WatchSource:0}: Error finding container a1f46380a1c5037851a0766c3936c1c7a8fd7ff136bf2fb11b96491b485a75be: Status 404 returned error can't find the container with id a1f46380a1c5037851a0766c3936c1c7a8fd7ff136bf2fb11b96491b485a75be
Jun 09 02:20:05.945961 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.945938    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:15:04 +0000 UTC" deadline="2027-11-05 02:12:26.377436542 +0000 UTC"
Jun 09 02:20:05.945961 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.945961    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12335h52m20.431479069s"
Jun 09 02:20:05.976542 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.976522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:05.976657 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:05.976639    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:05.986370 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.986129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7hq52" event={"ID":"028f4486-012b-42f5-827b-c85720a09d46","Type":"ContainerStarted","Data":"a6d0d1e59c6c6f0ac4f5c9a3da93112f62a3cad7e9e5f2ef66a69c4f15608685"}
Jun 09 02:20:05.988156 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.987977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j" event={"ID":"8beaa7bf-674a-4825-bcd4-00c81ef3bfba","Type":"ContainerStarted","Data":"23c01d5d1675924d774b731ac96d898c3cee16983251e3fa0ba3d453389384dc"}
Jun 09 02:20:05.989243 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.989219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmm89" event={"ID":"15b79ddd-1050-43e2-889d-b7c7bec1d7be","Type":"ContainerStarted","Data":"1e85fa2483591fd92da8b1152567d459d338988f1544cd667011ff292a7eeba5"}
Jun 09 02:20:05.991619 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.991551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzzdh" event={"ID":"a56aa665-0403-4186-a1ff-e442ee8f222f","Type":"ContainerStarted","Data":"2fde51caa47d39f39032d2cba5e353c25bcfbaab787660f6033c8a23e5fda980"}
Jun 09 02:20:05.994703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.994679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerStarted","Data":"d4183d3de71da2df8ce60a2e68f9f981e8892cfbfc53c5eaac8b0c57cf6a3495"}
Jun 09 02:20:05.996200 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.996179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx8ql" event={"ID":"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3","Type":"ContainerStarted","Data":"a1f46380a1c5037851a0766c3936c1c7a8fd7ff136bf2fb11b96491b485a75be"}
Jun 09 02:20:05.997224 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.997206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbhst" event={"ID":"54c9087d-2e5c-4b37-a785-439ad99fa62e","Type":"ContainerStarted","Data":"6bb3318bc9e494f9b1b7c864590c08affe5459390efa4274db4c1dbc650c35de"}
Jun 09 02:20:05.998165 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.998147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-758bx" event={"ID":"26354ed2-3f22-48d7-8f95-3dabdefe0281","Type":"ContainerStarted","Data":"7145a967c8883aecbb21f1cfb8363a28b129c522feb3cf3bea716e9e66497085"}
Jun 09 02:20:05.999130 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:05.999113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"826b137b7b5c1e447f0bedbbd473e7d7a53ec62801b5ab19e67fce36ffba6be7"}
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.542187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.542239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.542375    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.542429    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:08.542410865 +0000 UTC m=+6.016532499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.542866    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:06.542967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.542945    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:08.54292822 +0000 UTC m=+6.017049929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:06.642665 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.642628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:06.642844 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.642808    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:06.642844 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.642831    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:06.642844 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.642844    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:06.643036 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.642918    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:08.642885867 +0000 UTC m=+6.117007499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:06.946882 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.946623    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:15:04 +0000 UTC" deadline="2028-02-23 13:23:40.354338576 +0000 UTC"
Jun 09 02:20:06.946882 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.946682    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14987h3m33.407661011s"
Jun 09 02:20:06.976752 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.976284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:06.976752 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:06.976284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:06.976752 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.976418    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:06.976752 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:06.976489    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:07.023914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:07.023203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"965f1b021afe824ff609e26866618315c3ce54fb16b10a839a42028f25b4a940"}
Jun 09 02:20:07.026309 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:07.026239    2576 generic.go:356] "Generic (PLEG): container finished" podID="fa226fc2d2c5f842f452b30ccab5b919" containerID="56f64e8ad0cd885b26415887bb7908de078f1b09830c170ff72e96856ad98d95" exitCode=0
Jun 09 02:20:07.026420 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:07.026329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerDied","Data":"56f64e8ad0cd885b26415887bb7908de078f1b09830c170ff72e96856ad98d95"}
Jun 09 02:20:07.054510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:07.054460    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" podStartSLOduration=3.054442108 podStartE2EDuration="3.054442108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:07.040798486 +0000 UTC m=+4.514920139" watchObservedRunningTime="2026-06-09 02:20:07.054442108 +0000 UTC m=+4.528563762"
Jun 09 02:20:07.976392 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:07.976364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:07.976813 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:07.976492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:08.046404 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.046340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"9937f328fbd64fe2a588775659fde9534f622b871c86403cdf9c6bf1f2ba72b9"}
Jun 09 02:20:08.559561 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.559522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:08.559741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.559633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:08.559800 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.559765    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:08.559848 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.559831    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:12.559812186 +0000 UTC m=+10.033933823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:08.560260 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.560241    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:08.560350 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.560293    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:12.560278684 +0000 UTC m=+10.034400317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:08.660456 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.660416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:08.660620 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.660576    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:08.660620 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.660605    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:08.660620 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.660619    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:08.660780 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.660683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:12.660664588 +0000 UTC m=+10.134786222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:08.978831 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.978792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:08.979305 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.979014    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:08.979495 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:08.979465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:08.979666 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:08.979621    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:09.976379 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:09.976343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:09.976579 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:09.976485    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:10.976287 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:10.976239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:10.976747 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:10.976375    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:10.976747 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:10.976541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:10.976747 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:10.976638    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:11.976125 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:11.976090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:11.976312 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:11.976235    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:12.591328 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:12.591277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:12.591513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:12.591335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:12.591513 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.591467    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:12.591625 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.591467    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:12.591625 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.591533    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:20.591513279 +0000 UTC m=+18.065634913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:12.591625 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.591562    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:20.591551324 +0000 UTC m=+18.065672965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:12.692027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:12.691995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:12.692207 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.692151    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:12.692207 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.692173    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:12.692207 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.692189    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:12.692348 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.692259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:20.6922375 +0000 UTC m=+18.166359132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:12.976973 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:12.976869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:12.977386 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.977004    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:12.977386 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:12.977150    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:12.977386 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:12.977243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:13.976062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:13.976026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:13.976241 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:13.976152    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:14.976398 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:14.976363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:14.976853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:14.976492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:14.976853 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:14.976565    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:14.976853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:14.976714    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:15.975858 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:15.975826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:15.976013 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:15.975942    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:16.976664 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:16.976630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:16.976664 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:16.976669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:16.977105 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:16.976754    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:16.977105 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:16.976833    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:17.976632 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:17.976595    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:17.976802 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:17.976733    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:18.976242 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:18.976205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:18.976411 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:18.976333    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:18.976696 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:18.976670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:18.976791 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:18.976773    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:19.976450 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:19.976418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:19.976930 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:19.976527    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:20.651778 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:20.651734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:20.651994 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:20.651832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:20.651994 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.651852    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:20.651994 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.651926    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:20.651994 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.651938    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:36.651917353 +0000 UTC m=+34.126038988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:20.651994 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.651960    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:20:36.651949493 +0000 UTC m=+34.126071138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:20.752937 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:20.752888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:20.753114 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.753046    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:20.753114 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.753075    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:20.753114 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.753090    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:20.753260 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.753191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:36.753171638 +0000 UTC m=+34.227293271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:20.976190 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:20.976106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:20.976190 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:20.976118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:20.976395 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.976250    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:20.976444 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:20.976405    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:21.976429 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:21.976391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:21.976943 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:21.976529    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:22.977281 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:22.977249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:22.977726 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:22.977334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:22.977726 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:22.977352    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:22.977726 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:22.977455    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:23.975960 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:23.975938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:23.976085 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:23.976057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:24.977174 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:24.976863    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:24.977907 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:24.976928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:24.977907 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:24.977270    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:24.977907 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:24.977329    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:25.080439 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080416    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:20:25.080719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080700    2576 generic.go:356] "Generic (PLEG): container finished" podID="0deea437-1482-4f29-95c5-0e51bc5ba2a4" containerID="0f16d1819158f10a58dde4c35ed30a15cf1a6bedecf8092cc7e625b3ce470a41" exitCode=1
Jun 09 02:20:25.080785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"2e4e5d6156bc6c421e930bffb10832001605600c6964704f902b4c30415fa010"}
Jun 09 02:20:25.080853 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"bb5675fb4a90cebbb44b5ed123ab9d9aa7df39c8bb57c1008d64de25b9a98b91"}
Jun 09 02:20:25.080922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"4cb20d69c24b0e4755f53a494cb0fd5d3f9dfe2e5c8a3074e171856407ec7423"}
Jun 09 02:20:25.080974 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"7d73de6635a64de9df5296ae79e2f455493be9f21374dbb7cc45300ca16529b1"}
Jun 09 02:20:25.081023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.080973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerDied","Data":"0f16d1819158f10a58dde4c35ed30a15cf1a6bedecf8092cc7e625b3ce470a41"}
Jun 09 02:20:25.081023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.081004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"fb3a0e7ef0cf57010eb4ba044142857cdf5b227c1753264133a03c0dfa06b419"}
Jun 09 02:20:25.082048 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.082032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7hq52" event={"ID":"028f4486-012b-42f5-827b-c85720a09d46","Type":"ContainerStarted","Data":"b829ab63d1c10b9cb299f7aab59ec034d83b0ab8be32c8772c24ee6934de7438"}
Jun 09 02:20:25.083413 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.083391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j" event={"ID":"8beaa7bf-674a-4825-bcd4-00c81ef3bfba","Type":"ContainerStarted","Data":"b763bc96b053f68ee17d3c0ffe43fe78279df556adec5c532f1fdf2d0e6f547c"}
Jun 09 02:20:25.084625 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.084604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmm89" event={"ID":"15b79ddd-1050-43e2-889d-b7c7bec1d7be","Type":"ContainerStarted","Data":"5c2e19968464c21ca938e4e451f8333d04f8b41cceb422be7dc49867d8d5058a"}
Jun 09 02:20:25.085943 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.085921    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="9f77b6e56c3219749f980a9ab25bbc567e72ec7a4eed451014facb6412774b5a" exitCode=0
Jun 09 02:20:25.086018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.086006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"9f77b6e56c3219749f980a9ab25bbc567e72ec7a4eed451014facb6412774b5a"}
Jun 09 02:20:25.087287 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.087267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx8ql" event={"ID":"11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3","Type":"ContainerStarted","Data":"d7a08d7dd67bbb1c2813893c0c1555d0b5ec1061ed7cf5e3c953ebcd4f5a0ecd"}
Jun 09 02:20:25.088493 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.088473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbhst" event={"ID":"54c9087d-2e5c-4b37-a785-439ad99fa62e","Type":"ContainerStarted","Data":"8ea1804f10c30a53ba7fcec80f1a7bc1621f577b0343ddbd5ac1f2dba6e6a339"}
Jun 09 02:20:25.089651 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.089634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-758bx" event={"ID":"26354ed2-3f22-48d7-8f95-3dabdefe0281","Type":"ContainerStarted","Data":"d6cfc62e139a493920b54f703dcc62054a0ec2992d147a7749c977ce640435e5"}
Jun 09 02:20:25.095337 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.095305    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7hq52" podStartSLOduration=8.626094525 podStartE2EDuration="22.095294204s" totalImagesPullingTime="13.469199679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:25.09503686 +0000 UTC m=+22.569158514" watchObservedRunningTime="2026-06-09 02:20:25.095294204 +0000 UTC m=+22.569415881"
Jun 09 02:20:25.095653 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.095635    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" podStartSLOduration=21.095630682 podStartE2EDuration="21.095630682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:08.060123637 +0000 UTC m=+5.534245292" watchObservedRunningTime="2026-06-09 02:20:25.095630682 +0000 UTC m=+22.569752333"
Jun 09 02:20:25.139525 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.139492    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmm89" podStartSLOduration=4.068065596 podStartE2EDuration="22.139480035s" totalImagesPullingTime="18.071414439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:25.12666887 +0000 UTC m=+22.600790522" watchObservedRunningTime="2026-06-09 02:20:25.139480035 +0000 UTC m=+22.613601688"
Jun 09 02:20:25.160214 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.158137    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dbhst" podStartSLOduration=4.110655284 podStartE2EDuration="22.158106195s" totalImagesPullingTime="18.047450911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:25.157976247 +0000 UTC m=+22.632097900" watchObservedRunningTime="2026-06-09 02:20:25.158106195 +0000 UTC m=+22.632227841"
Jun 09 02:20:25.160214 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.158621    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-758bx" podStartSLOduration=4.134726606 podStartE2EDuration="22.158611974s" totalImagesPullingTime="18.023885368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:25.139601002 +0000 UTC m=+22.613722638" watchObservedRunningTime="2026-06-09 02:20:25.158611974 +0000 UTC m=+22.632733628"
Jun 09 02:20:25.171834 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.171805    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bx8ql" podStartSLOduration=4.127934512 podStartE2EDuration="22.171795175s" totalImagesPullingTime="18.043860663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:25.171783703 +0000 UTC m=+22.645905347" watchObservedRunningTime="2026-06-09 02:20:25.171795175 +0000 UTC m=+22.645916822"
Jun 09 02:20:25.341333 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.341311    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 09 02:20:25.976434 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.976396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:25.976625 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:25.976518    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:25.977401 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.977321    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T02:20:25.341327572Z","UUID":"c1456879-a934-473f-aaaa-b2f1ad318648","Handler":null,"Name":"","Endpoint":""}
Jun 09 02:20:25.979075 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.979046    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 09 02:20:25.979230 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:25.979088    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 09 02:20:26.034111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.034083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:26.034704 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.034681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:26.094441 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.094403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j" event={"ID":"8beaa7bf-674a-4825-bcd4-00c81ef3bfba","Type":"ContainerStarted","Data":"8828545ca19fe031cdcca1be73cd91611a6946fbf73de447f23b7875142ff53a"}
Jun 09 02:20:26.095922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.095842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzzdh" event={"ID":"a56aa665-0403-4186-a1ff-e442ee8f222f","Type":"ContainerStarted","Data":"69cd8c4f0edaffa709e726fa7c4ea3e881ec778ca055f5ab48be9e068d6c9d0b"}
Jun 09 02:20:26.096439 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.096417    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:26.096938 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.096917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7hq52"
Jun 09 02:20:26.109822 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.109778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nzzdh" podStartSLOduration=5.053621384 podStartE2EDuration="23.10976219s" totalImagesPullingTime="18.056140806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:26.109420039 +0000 UTC m=+23.583541715" watchObservedRunningTime="2026-06-09 02:20:26.10976219 +0000 UTC m=+23.583883845"
Jun 09 02:20:26.976063 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.976036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:26.976246 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:26.976149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:26.976246 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:26.976210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:26.976355 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:26.976335    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:27.101725 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:27.101649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:20:27.102176 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:27.102063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"a1385aa6e934a7bf4ecc818914da1d27e000ed75bd577d861de41ebde6646373"}
Jun 09 02:20:27.104313 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:27.104287    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j" event={"ID":"8beaa7bf-674a-4825-bcd4-00c81ef3bfba","Type":"ContainerStarted","Data":"5749cea38b1c4edf0803152970bbf8425ddca38423df6e56cb40b77b671c2aaf"}
Jun 09 02:20:27.976465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:27.976257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:27.976636 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:27.976555    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:28.976807 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:28.976774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:28.977214 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:28.976922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:28.977214 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:28.976959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:28.977214 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:28.977064    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:29.975878 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:29.975844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:29.976091 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:29.976014    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:30.975995 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:30.975966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:30.976767 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:30.975973    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:30.976767 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:30.976088    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:30.976767 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:30.976123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:31.113874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.113704    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="9d7807cbdae9d9879c44e1b1ec56df16df6243d3573375c6c57e63225cae0a9e" exitCode=0
Jun 09 02:20:31.114065 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.113789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"9d7807cbdae9d9879c44e1b1ec56df16df6243d3573375c6c57e63225cae0a9e"}
Jun 09 02:20:31.117434 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.117419    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:20:31.117763 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.117745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"71eee655a542702553e1f38adb4d159581540aad4f98a00d183e34e5d054b3bc"}
Jun 09 02:20:31.118002 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.117988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:31.118071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.118061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:31.118199 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.118183    2576 scope.go:117] "RemoveContainer" containerID="0f16d1819158f10a58dde4c35ed30a15cf1a6bedecf8092cc7e625b3ce470a41"
Jun 09 02:20:31.134283 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.134264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:31.138429 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.138394    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdf6j" podStartSLOduration=8.198237333 podStartE2EDuration="28.138383158s" totalImagesPullingTime="19.940145825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:27.121543412 +0000 UTC m=+24.595665065" watchObservedRunningTime="2026-06-09 02:20:31.138383158 +0000 UTC m=+28.612504862"
Jun 09 02:20:31.976269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:31.976241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:31.976585 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:31.976378    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:32.123485 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.123416    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:20:32.123870 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.123844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" event={"ID":"0deea437-1482-4f29-95c5-0e51bc5ba2a4","Type":"ContainerStarted","Data":"02c1cd8a5ddf3c683b7994d3e936f4957529385efc474ab377132bea30b5b92a"}
Jun 09 02:20:32.124167 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.124147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:32.125951 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.125926    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="88954c11087747ba4ee8bb8c67c7bc78e79a1edb6d52001cb9b02bb0c7d65b98" exitCode=0
Jun 09 02:20:32.126042 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.125965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"88954c11087747ba4ee8bb8c67c7bc78e79a1edb6d52001cb9b02bb0c7d65b98"}
Jun 09 02:20:32.139429 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.139409    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:20:32.154083 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.154049    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc" podStartSLOduration=11.053999569 podStartE2EDuration="29.154037629s" totalImagesPullingTime="18.10003806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:32.152233677 +0000 UTC m=+29.626355329" watchObservedRunningTime="2026-06-09 02:20:32.154037629 +0000 UTC m=+29.628159282"
Jun 09 02:20:32.174772 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.174747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hng4"]
Jun 09 02:20:32.174922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.174836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:32.174993 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:32.174959    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:32.175468 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.175452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p4h2s"]
Jun 09 02:20:32.175534 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.175525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:32.175600 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:32.175584    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:32.184851 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.184833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnvkg"]
Jun 09 02:20:32.184936 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:32.184924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:32.185018 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:32.185004    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:33.130089 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:33.130050    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="de07cedaf1c82770728f86831168aea0906bcc44cc3e533f99fc192c89796b69" exitCode=0
Jun 09 02:20:33.130484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:33.130141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"de07cedaf1c82770728f86831168aea0906bcc44cc3e533f99fc192c89796b69"}
Jun 09 02:20:33.976104 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:33.976027    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:33.976104 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:33.976067    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:33.976276 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:33.976175    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:33.976276 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:33.976187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:33.976440 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:33.976348    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:33.976440 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:33.976429    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:35.976583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:35.976394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:35.977048 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:35.976394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:35.977048 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:35.976668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p4h2s" podUID="a7766748-699a-4627-aac7-7266faf7745f"
Jun 09 02:20:35.977048 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:35.976776    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:20:35.977048 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:35.976394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:35.977048 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:35.976922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hng4" podUID="5e83470f-9c46-4ede-a475-c42e413676ce"
Jun 09 02:20:36.679017 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:36.678972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:36.679278 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:36.679028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:36.679278 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.679134    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:36.679278 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.679136    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:36.679278 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.679191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:08.679177845 +0000 UTC m=+66.153299476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 02:20:36.679278 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.679205    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret podName:5e83470f-9c46-4ede-a475-c42e413676ce nodeName:}" failed. No retries permitted until 2026-06-09 02:21:08.679199079 +0000 UTC m=+66.153320711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret") pod "global-pull-secret-syncer-6hng4" (UID: "5e83470f-9c46-4ede-a475-c42e413676ce") : object "kube-system"/"original-pull-secret" not registered
Jun 09 02:20:36.780070 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:36.780023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:36.780234 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.780208    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 02:20:36.780234 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.780229    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 02:20:36.780309 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.780238    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crdjz for pod openshift-network-diagnostics/network-check-target-p4h2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:36.780309 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:36.780292    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz podName:a7766748-699a-4627-aac7-7266faf7745f nodeName:}" failed. No retries permitted until 2026-06-09 02:21:08.780278163 +0000 UTC m=+66.254399794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-crdjz" (UniqueName: "kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz") pod "network-check-target-p4h2s" (UID: "a7766748-699a-4627-aac7-7266faf7745f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 02:20:37.933604 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.933536    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeReady"
Jun 09 02:20:37.934047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.933633    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 09 02:20:37.972779 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.972748    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b5gxr"]
Jun 09 02:20:37.976206 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.976184    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5lwmp"]
Jun 09 02:20:37.976324 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.976290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:37.979503 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.979276    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 09 02:20:37.979503 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.979361    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\""
Jun 09 02:20:37.979503 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.979448    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 09 02:20:37.982169 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.982148    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:20:37.982169 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.982160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:20:37.982331 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.982177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:20:37.982331 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.982235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:37.984505 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.984484    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 02:20:37.984599 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.984508    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 09 02:20:37.984599 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.984542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 09 02:20:37.984705 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.984613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\""
Jun 09 02:20:37.986005 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.985767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 02:20:37.986647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.986219    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 02:20:37.986647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.986429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 02:20:37.986647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.986492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dvgs\""
Jun 09 02:20:37.986647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.986566    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\""
Jun 09 02:20:37.986647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.986620    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 09 02:20:37.987270 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.987252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5gxr"]
Jun 09 02:20:37.988869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:37.988852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lwmp"]
Jun 09 02:20:38.090053 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-tmp-dir\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.090202 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgkh\" (UniqueName: \"kubernetes.io/projected/933e1b22-dac8-43de-acbd-7848442bbde1-kube-api-access-wcgkh\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.090202 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.090202 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-config-volume\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.090333 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grb9m\" (UniqueName: \"kubernetes.io/projected/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-kube-api-access-grb9m\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.090333 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.090222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/933e1b22-dac8-43de-acbd-7848442bbde1-cert\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.143355 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.143328    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="1c0860de0493f9a584d951dac85d694af0d64402ec1eb3b51aefdb760d448839" exitCode=0
Jun 09 02:20:38.143466 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.143381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"1c0860de0493f9a584d951dac85d694af0d64402ec1eb3b51aefdb760d448839"}
Jun 09 02:20:38.190739 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.190868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-config-volume\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.190868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grb9m\" (UniqueName: \"kubernetes.io/projected/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-kube-api-access-grb9m\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.190868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/933e1b22-dac8-43de-acbd-7848442bbde1-cert\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.190868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-tmp-dir\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.190868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.190842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgkh\" (UniqueName: \"kubernetes.io/projected/933e1b22-dac8-43de-acbd-7848442bbde1-kube-api-access-wcgkh\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.191154 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:38.190886    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:38.191154 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:38.191000    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:38.690967238 +0000 UTC m=+36.165089231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:20:38.191315 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.191294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-tmp-dir\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.191390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.191357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-config-volume\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.194932 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.194913    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/933e1b22-dac8-43de-acbd-7848442bbde1-cert\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.199037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.199015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grb9m\" (UniqueName: \"kubernetes.io/projected/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-kube-api-access-grb9m\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.199037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.199027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgkh\" (UniqueName: \"kubernetes.io/projected/933e1b22-dac8-43de-acbd-7848442bbde1-kube-api-access-wcgkh\") pod \"ingress-canary-5lwmp\" (UID: \"933e1b22-dac8-43de-acbd-7848442bbde1\") " pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.306356 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.306330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lwmp"
Jun 09 02:20:38.431298 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.431138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lwmp"]
Jun 09 02:20:38.434806 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:20:38.434783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933e1b22_dac8_43de_acbd_7848442bbde1.slice/crio-84bbf15056c4904c22c565d63784f3819f98b80a86b848770affe27e3457a0e9 WatchSource:0}: Error finding container 84bbf15056c4904c22c565d63784f3819f98b80a86b848770affe27e3457a0e9: Status 404 returned error can't find the container with id 84bbf15056c4904c22c565d63784f3819f98b80a86b848770affe27e3457a0e9
Jun 09 02:20:38.696597 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:38.696569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:38.696762 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:38.696710    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:38.696805 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:38.696769    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:39.69675408 +0000 UTC m=+37.170875711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:20:39.148623 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:39.148589    2576 generic.go:356] "Generic (PLEG): container finished" podID="be7b16f6-1842-4335-a815-65c29230016a" containerID="5c242b39b6c2c172f1d4e87862b48477de3fa39258c1196fb9e1705b7712166e" exitCode=0
Jun 09 02:20:39.149379 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:39.148671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerDied","Data":"5c242b39b6c2c172f1d4e87862b48477de3fa39258c1196fb9e1705b7712166e"}
Jun 09 02:20:39.149871 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:39.149852    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lwmp" event={"ID":"933e1b22-dac8-43de-acbd-7848442bbde1","Type":"ContainerStarted","Data":"84bbf15056c4904c22c565d63784f3819f98b80a86b848770affe27e3457a0e9"}
Jun 09 02:20:39.704600 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:39.704564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:39.704792 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:39.704738    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:39.704841 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:39.704811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:41.70479274 +0000 UTC m=+39.178914371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:20:40.155184 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:40.155154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" event={"ID":"be7b16f6-1842-4335-a815-65c29230016a","Type":"ContainerStarted","Data":"01bff113822b004f37de707abcd01508f75a1b8e60c8d5311dad01e2dda601e3"}
Jun 09 02:20:40.177230 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:40.177184    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7pxd9" podStartSLOduration=8.88658484 podStartE2EDuration="37.177170077s" totalImagesPullingTime="28.290585237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:40.176697076 +0000 UTC m=+37.650818729" watchObservedRunningTime="2026-06-09 02:20:40.177170077 +0000 UTC m=+37.651291730"
Jun 09 02:20:41.158904 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:41.158855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lwmp" event={"ID":"933e1b22-dac8-43de-acbd-7848442bbde1","Type":"ContainerStarted","Data":"868e5cca564713b499f276d331b59c12dfa1fb5b322ee91db22b707beec9e4ba"}
Jun 09 02:20:41.719843 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:41.719811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:41.720010 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:41.719986    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:41.720316 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:41.720040    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:45.720027759 +0000 UTC m=+43.194149390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:20:45.745935 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:45.745882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:45.746395 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:45.746038    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:45.746395 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:45.746103    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:20:53.74608737 +0000 UTC m=+51.220209001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:20:53.802922 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:20:53.802879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:20:53.803429 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:53.802998    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:20:53.803429 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:20:53.803046    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:21:09.803032683 +0000 UTC m=+67.277154314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:21:04.143289 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:04.143259    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjhqc"
Jun 09 02:21:04.169101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:04.169051    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5lwmp" podStartSLOduration=25.435980349 podStartE2EDuration="27.169035437s" totalImagesPullingTime="1.733055088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:41.172621891 +0000 UTC m=+38.646743543" watchObservedRunningTime="2026-06-09 02:21:04.169035437 +0000 UTC m=+61.643157068"
Jun 09 02:21:08.698406 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.698371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:21:08.698773 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.698457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:21:08.700969 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.700950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 02:21:08.701226 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.701213    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 02:21:08.709227 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:08.709213    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 02:21:08.709283 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:08.709271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:12.70925135 +0000 UTC m=+130.183372981 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : secret "metrics-daemon-secret" not found
Jun 09 02:21:08.712791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.712767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e83470f-9c46-4ede-a475-c42e413676ce-original-pull-secret\") pod \"global-pull-secret-syncer-6hng4\" (UID: \"5e83470f-9c46-4ede-a475-c42e413676ce\") " pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:21:08.799616 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.799586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:21:08.802489 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.802472    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 02:21:08.813216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.813197    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 02:21:08.823482 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.823458    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdjz\" (UniqueName: \"kubernetes.io/projected/a7766748-699a-4627-aac7-7266faf7745f-kube-api-access-crdjz\") pod \"network-check-target-p4h2s\" (UID: \"a7766748-699a-4627-aac7-7266faf7745f\") " pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:21:08.897521 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.897496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\""
Jun 09 02:21:08.905678 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.905659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:21:08.910883 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:08.910869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hng4"
Jun 09 02:21:09.035556 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:09.035373    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p4h2s"]
Jun 09 02:21:09.038066 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:21:09.038042    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7766748_699a_4627_aac7_7266faf7745f.slice/crio-491aa5a28a1b57ce58970e697bc0d04afc82142e619248ce3b4bd02d0f55cc8c WatchSource:0}: Error finding container 491aa5a28a1b57ce58970e697bc0d04afc82142e619248ce3b4bd02d0f55cc8c: Status 404 returned error can't find the container with id 491aa5a28a1b57ce58970e697bc0d04afc82142e619248ce3b4bd02d0f55cc8c
Jun 09 02:21:09.050655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:09.050628    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hng4"]
Jun 09 02:21:09.052939 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:21:09.052916    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e83470f_9c46_4ede_a475_c42e413676ce.slice/crio-0885d5895009d45a3c0ebe3a31ace7fb18ac46511561d530b07188984d5afe29 WatchSource:0}: Error finding container 0885d5895009d45a3c0ebe3a31ace7fb18ac46511561d530b07188984d5afe29: Status 404 returned error can't find the container with id 0885d5895009d45a3c0ebe3a31ace7fb18ac46511561d530b07188984d5afe29
Jun 09 02:21:09.220014 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:09.219917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hng4" event={"ID":"5e83470f-9c46-4ede-a475-c42e413676ce","Type":"ContainerStarted","Data":"0885d5895009d45a3c0ebe3a31ace7fb18ac46511561d530b07188984d5afe29"}
Jun 09 02:21:09.220913 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:09.220870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p4h2s" event={"ID":"a7766748-699a-4627-aac7-7266faf7745f","Type":"ContainerStarted","Data":"491aa5a28a1b57ce58970e697bc0d04afc82142e619248ce3b4bd02d0f55cc8c"}
Jun 09 02:21:09.805902 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:09.805629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:21:09.805902 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:09.805765    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:21:09.805902 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:09.805843    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:21:41.805821441 +0000 UTC m=+99.279943073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:21:14.235699 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:14.235660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hng4" event={"ID":"5e83470f-9c46-4ede-a475-c42e413676ce","Type":"ContainerStarted","Data":"8ecd79aab4e7c1fd44e8af434bbb06776c0ca4304a1074e9186e81eddb3d87c7"}
Jun 09 02:21:14.237028 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:14.237005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p4h2s" event={"ID":"a7766748-699a-4627-aac7-7266faf7745f","Type":"ContainerStarted","Data":"0b1020d43f44e4462bef38a52209cf1e368628f5e23246be29b1f93f4fcf3db8"}
Jun 09 02:21:14.237145 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:14.237129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:21:14.250138 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:14.250099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6hng4" podStartSLOduration=66.965214936 podStartE2EDuration="1m11.25008747s" totalImagesPullingTime="4.284872534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:21:14.249260836 +0000 UTC m=+71.723382490" watchObservedRunningTime="2026-06-09 02:21:14.25008747 +0000 UTC m=+71.724209122"
Jun 09 02:21:14.262933 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:14.262884    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p4h2s" podStartSLOduration=66.967938718 podStartE2EDuration="1m11.262873836s" totalImagesPullingTime="4.294935118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:21:14.261980312 +0000 UTC m=+71.736101965" watchObservedRunningTime="2026-06-09 02:21:14.262873836 +0000 UTC m=+71.736995511"
Jun 09 02:21:41.820428 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:41.820378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:21:41.820822 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:41.820538    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:21:41.820822 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:21:41.820611    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:22:45.820595555 +0000 UTC m=+163.294717186 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:21:45.241741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:21:45.241713    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p4h2s"
Jun 09 02:22:12.723076 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:12.723032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:22:12.723528 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:12.723182    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 02:22:12.723528 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:12.723256    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs podName:e70df090-e6a8-49c3-a22f-25e688e969a6 nodeName:}" failed. No retries permitted until 2026-06-09 02:24:14.723239669 +0000 UTC m=+252.197361300 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs") pod "network-metrics-daemon-gnvkg" (UID: "e70df090-e6a8-49c3-a22f-25e688e969a6") : secret "metrics-daemon-secret" not found
Jun 09 02:22:40.988648 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:40.988601    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5gxr" podUID="edd2eab8-cc93-40eb-9564-6d1307ceeb2f"
Jun 09 02:22:41.000736 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:41.000711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gnvkg" podUID="e70df090-e6a8-49c3-a22f-25e688e969a6"
Jun 09 02:22:41.435282 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:41.435196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:22:45.834472 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:45.834395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:22:45.834992 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:45.834501    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 02:22:45.835151 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:45.835131    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls podName:edd2eab8-cc93-40eb-9564-6d1307ceeb2f nodeName:}" failed. No retries permitted until 2026-06-09 02:24:47.835103395 +0000 UTC m=+285.309225046 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls") pod "dns-default-b5gxr" (UID: "edd2eab8-cc93-40eb-9564-6d1307ceeb2f") : secret "dns-default-metrics-tls" not found
Jun 09 02:22:48.119280 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.119248    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"]
Jun 09 02:22:48.122043 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.122023    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"]
Jun 09 02:22:48.122176 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.122145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.124642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.124624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.124762 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.124623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 09 02:22:48.124824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.124783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 09 02:22:48.125244 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.125220    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 09 02:22:48.125344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.125246    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:22:48.125344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.125319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z26v8\""
Jun 09 02:22:48.127055 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.127038    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:22:48.127216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.127204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 09 02:22:48.127305 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.127291    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 09 02:22:48.127365 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.127304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t266f\""
Jun 09 02:22:48.127365 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.127346    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 09 02:22:48.132243 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.132223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"]
Jun 09 02:22:48.132881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.132864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"]
Jun 09 02:22:48.211431 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.211398    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"]
Jun 09 02:22:48.214228 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.214209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"
Jun 09 02:22:48.216853 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.216813    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 09 02:22:48.217006 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.216908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r556v\""
Jun 09 02:22:48.217006 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.216963    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:22:48.218266 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.218248    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c49cbd847-xhn2t"]
Jun 09 02:22:48.220739 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.220723    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:22:48.220869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.220853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.223434 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.223416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.223710 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.223693    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 09 02:22:48.223905 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.223875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 09 02:22:48.224070 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.223977    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 09 02:22:48.224586 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.224564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 09 02:22:48.224820 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.224801    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 09 02:22:48.224927 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.224834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-754xh\""
Jun 09 02:22:48.224927 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.224873    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 09 02:22:48.224927 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.224913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"]
Jun 09 02:22:48.226978 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.226961    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 09 02:22:48.227067 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.226978    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mhf5x\""
Jun 09 02:22:48.227067 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.227042    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 09 02:22:48.228117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.228101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 09 02:22:48.235716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.235663    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 09 02:22:48.240737 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.240712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c49cbd847-xhn2t"]
Jun 09 02:22:48.241389 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.241372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:22:48.250307 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9593550b-97a8-499a-be99-2bf5fc294a24-config\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.250391 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lbcm\" (UniqueName: \"kubernetes.io/projected/9593550b-97a8-499a-be99-2bf5fc294a24-kube-api-access-6lbcm\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.250391 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70d6ccb-8c58-4102-96d6-c7877fc49915-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.250484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70d6ccb-8c58-4102-96d6-c7877fc49915-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.250484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88scn\" (UniqueName: \"kubernetes.io/projected/b70d6ccb-8c58-4102-96d6-c7877fc49915-kube-api-access-88scn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.250557 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.250501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9593550b-97a8-499a-be99-2bf5fc294a24-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.351318 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-default-certificate\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-stats-auth\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76d4l\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88scn\" (UniqueName: \"kubernetes.io/projected/b70d6ccb-8c58-4102-96d6-c7877fc49915-kube-api-access-88scn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfksx\" (UniqueName: \"kubernetes.io/projected/cbacd8fb-cb16-4091-87b7-eec245cb2f4b-kube-api-access-tfksx\") pod \"volume-data-source-validator-78dd696465-6455p\" (UID: \"cbacd8fb-cb16-4091-87b7-eec245cb2f4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9593550b-97a8-499a-be99-2bf5fc294a24-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9593550b-97a8-499a-be99-2bf5fc294a24-config\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.351733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbcm\" (UniqueName: \"kubernetes.io/projected/9593550b-97a8-499a-be99-2bf5fc294a24-kube-api-access-6lbcm\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.352101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.352101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.352101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70d6ccb-8c58-4102-96d6-c7877fc49915-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.352101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l472r\" (UniqueName: \"kubernetes.io/projected/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-kube-api-access-l472r\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.352101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.351953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70d6ccb-8c58-4102-96d6-c7877fc49915-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.352352 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.352333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9593550b-97a8-499a-be99-2bf5fc294a24-config\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.352455 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.352440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b70d6ccb-8c58-4102-96d6-c7877fc49915-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.353792 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.353774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9593550b-97a8-499a-be99-2bf5fc294a24-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.353868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.353821    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b70d6ccb-8c58-4102-96d6-c7877fc49915-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.359087 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.359065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lbcm\" (UniqueName: \"kubernetes.io/projected/9593550b-97a8-499a-be99-2bf5fc294a24-kube-api-access-6lbcm\") pod \"service-ca-operator-6bc5ff68f5-kpg9w\" (UID: \"9593550b-97a8-499a-be99-2bf5fc294a24\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.359225 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.359206    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88scn\" (UniqueName: \"kubernetes.io/projected/b70d6ccb-8c58-4102-96d6-c7877fc49915-kube-api-access-88scn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-cfs9q\" (UID: \"b70d6ccb-8c58-4102-96d6-c7877fc49915\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.432033 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.431968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"
Jun 09 02:22:48.437861 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.437847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"
Jun 09 02:22:48.452791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l472r\" (UniqueName: \"kubernetes.io/projected/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-kube-api-access-l472r\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.452914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.452914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.452914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-default-certificate\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.452914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-stats-auth\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.452945    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.452962    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d9c6fd8b-mtwt4: secret "image-registry-tls" not found
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.452978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76d4l\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.453027    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls podName:cdb209a3-6879-4acb-90aa-e9efb5287de7 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:48.953007877 +0000 UTC m=+166.427129508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls") pod "image-registry-59d9c6fd8b-mtwt4" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7") : secret "image-registry-tls" not found
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfksx\" (UniqueName: \"kubernetes.io/projected/cbacd8fb-cb16-4091-87b7-eec245cb2f4b-kube-api-access-tfksx\") pod \"volume-data-source-validator-78dd696465-6455p\" (UID: \"cbacd8fb-cb16-4091-87b7-eec245cb2f4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.453133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453552 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.453318    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 09 02:22:48.453552 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.453484    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:48.953460431 +0000 UTC m=+166.427582080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : secret "router-metrics-certs-default" not found
Jun 09 02:22:48.453650 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.453585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:48.953574099 +0000 UTC m=+166.427695731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:22:48.453650 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.453851 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.453730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.454140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.454095    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.455047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.455005    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.456004 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.455960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.456110 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.456018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-stats-auth\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.456332 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.456312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.456498 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.456482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-default-certificate\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.461821 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.461796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l472r\" (UniqueName: \"kubernetes.io/projected/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-kube-api-access-l472r\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.462062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.462045    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfksx\" (UniqueName: \"kubernetes.io/projected/cbacd8fb-cb16-4091-87b7-eec245cb2f4b-kube-api-access-tfksx\") pod \"volume-data-source-validator-78dd696465-6455p\" (UID: \"cbacd8fb-cb16-4091-87b7-eec245cb2f4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"
Jun 09 02:22:48.462120 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.462105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76d4l\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.462379 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.462363    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.523184 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.523154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"
Jun 09 02:22:48.564617 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.564500    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w"]
Jun 09 02:22:48.567071 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:22:48.567030    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9593550b_97a8_499a_be99_2bf5fc294a24.slice/crio-65a6f0466af525cb323df56a87127fc4cb997c31374e8d82248e0bcf8d002d96 WatchSource:0}: Error finding container 65a6f0466af525cb323df56a87127fc4cb997c31374e8d82248e0bcf8d002d96: Status 404 returned error can't find the container with id 65a6f0466af525cb323df56a87127fc4cb997c31374e8d82248e0bcf8d002d96
Jun 09 02:22:48.575107 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.575085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q"]
Jun 09 02:22:48.578701 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:22:48.578671    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70d6ccb_8c58_4102_96d6_c7877fc49915.slice/crio-3338efe7532585df18b7f0dbd6e1fed3fb4001f8bdb3f8dc797d408e0a62d8d8 WatchSource:0}: Error finding container 3338efe7532585df18b7f0dbd6e1fed3fb4001f8bdb3f8dc797d408e0a62d8d8: Status 404 returned error can't find the container with id 3338efe7532585df18b7f0dbd6e1fed3fb4001f8bdb3f8dc797d408e0a62d8d8
Jun 09 02:22:48.648004 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.647983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p"]
Jun 09 02:22:48.650069 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:22:48.650047    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbacd8fb_cb16_4091_87b7_eec245cb2f4b.slice/crio-8482d9e920ad046228a7009fc3eab1014664e29e33740d7bd2e1c364127a616f WatchSource:0}: Error finding container 8482d9e920ad046228a7009fc3eab1014664e29e33740d7bd2e1c364127a616f: Status 404 returned error can't find the container with id 8482d9e920ad046228a7009fc3eab1014664e29e33740d7bd2e1c364127a616f
Jun 09 02:22:48.957577 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.957546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:48.957728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.957585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.957728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:48.957628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:48.957728 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957704    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 02:22:48.957728 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957722    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d9c6fd8b-mtwt4: secret "image-registry-tls" not found
Jun 09 02:22:48.957853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957769    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 09 02:22:48.957853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957789    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls podName:cdb209a3-6879-4acb-90aa-e9efb5287de7 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.957764707 +0000 UTC m=+167.431886345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls") pod "image-registry-59d9c6fd8b-mtwt4" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7") : secret "image-registry-tls" not found
Jun 09 02:22:48.957853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957804    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.957798066 +0000 UTC m=+167.431919697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:22:48.957853 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:48.957827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.95780962 +0000 UTC m=+167.431931252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : secret "router-metrics-certs-default" not found
Jun 09 02:22:49.453740 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.453697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w" event={"ID":"9593550b-97a8-499a-be99-2bf5fc294a24","Type":"ContainerStarted","Data":"65a6f0466af525cb323df56a87127fc4cb997c31374e8d82248e0bcf8d002d96"}
Jun 09 02:22:49.454840 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.454814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p" event={"ID":"cbacd8fb-cb16-4091-87b7-eec245cb2f4b","Type":"ContainerStarted","Data":"8482d9e920ad046228a7009fc3eab1014664e29e33740d7bd2e1c364127a616f"}
Jun 09 02:22:49.455844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.455822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q" event={"ID":"b70d6ccb-8c58-4102-96d6-c7877fc49915","Type":"ContainerStarted","Data":"3338efe7532585df18b7f0dbd6e1fed3fb4001f8bdb3f8dc797d408e0a62d8d8"}
Jun 09 02:22:49.965712 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.965640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:49.965934 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.965755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:49.965934 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:49.965789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:49.965934 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.965844    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:51.965821616 +0000 UTC m=+169.439943267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:22:49.965934 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.965922    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 09 02:22:49.966150 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.966002    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:51.965986636 +0000 UTC m=+169.440108272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : secret "router-metrics-certs-default" not found
Jun 09 02:22:49.966150 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.966069    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 02:22:49.966150 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.966078    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d9c6fd8b-mtwt4: secret "image-registry-tls" not found
Jun 09 02:22:49.966150 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:49.966113    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls podName:cdb209a3-6879-4acb-90aa-e9efb5287de7 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:51.966100302 +0000 UTC m=+169.440221934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls") pod "image-registry-59d9c6fd8b-mtwt4" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7") : secret "image-registry-tls" not found
Jun 09 02:22:50.460340 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:50.460303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p" event={"ID":"cbacd8fb-cb16-4091-87b7-eec245cb2f4b","Type":"ContainerStarted","Data":"20ed9ebe789cbd048a1bb012c5cd26f6b2de2c5cae98758801e8333de1ff07f7"}
Jun 09 02:22:51.469435 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.469392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w" event={"ID":"9593550b-97a8-499a-be99-2bf5fc294a24","Type":"ContainerStarted","Data":"2b5c2bba30ddf3d9d4253f446ea07fb852d9f2d54122cbe877beee96b0b807b0"}
Jun 09 02:22:51.470937 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.470910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q" event={"ID":"b70d6ccb-8c58-4102-96d6-c7877fc49915","Type":"ContainerStarted","Data":"e9c905a72bff119511e02fc917c8272edfb9e8d7d24a0f9cdfc0cd33f598538b"}
Jun 09 02:22:51.484828 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.484778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w" podStartSLOduration=0.713699759 podStartE2EDuration="3.484761564s" totalImagesPullingTime="2.771061805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:51.482516156 +0000 UTC m=+168.956637799" watchObservedRunningTime="2026-06-09 02:22:51.484761564 +0000 UTC m=+168.958883218"
Jun 09 02:22:51.485085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.485059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6455p" podStartSLOduration=2.096550445 podStartE2EDuration="3.485053977s" totalImagesPullingTime="1.388503532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:50.473713296 +0000 UTC m=+167.947834951" watchObservedRunningTime="2026-06-09 02:22:51.485053977 +0000 UTC m=+168.959175631"
Jun 09 02:22:51.496033 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.495995    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q" podStartSLOduration=0.738101124 podStartE2EDuration="3.49598156s" totalImagesPullingTime="2.757880436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:51.49547361 +0000 UTC m=+168.969595267" watchObservedRunningTime="2026-06-09 02:22:51.49598156 +0000 UTC m=+168.970103213"
Jun 09 02:22:51.983502 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.983460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:51.983668 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.983515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:51.983668 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:51.983564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:51.983668 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983604    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 02:22:51.983668 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983623    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d9c6fd8b-mtwt4: secret "image-registry-tls" not found
Jun 09 02:22:51.983862 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983676    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls podName:cdb209a3-6879-4acb-90aa-e9efb5287de7 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:55.983661036 +0000 UTC m=+173.457782667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls") pod "image-registry-59d9c6fd8b-mtwt4" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7") : secret "image-registry-tls" not found
Jun 09 02:22:51.983862 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983680    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 09 02:22:51.983862 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983727    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:55.983712044 +0000 UTC m=+173.457833679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:22:51.983862 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:51.983747    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:22:55.983738142 +0000 UTC m=+173.457859782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : secret "router-metrics-certs-default" not found
Jun 09 02:22:53.211239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.211205    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"]
Jun 09 02:22:53.214883 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.214857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"
Jun 09 02:22:53.217335 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.217308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 09 02:22:53.217440 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.217381    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4b4q2\""
Jun 09 02:22:53.218530 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.218513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 09 02:22:53.223514 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.223493    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"]
Jun 09 02:22:53.394723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.394695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpp59\" (UniqueName: \"kubernetes.io/projected/2abd80d6-bb90-4d50-be83-22497de753b9-kube-api-access-xpp59\") pod \"migrator-955ffdf5f-vbx7b\" (UID: \"2abd80d6-bb90-4d50-be83-22497de753b9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"
Jun 09 02:22:53.495873 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.495846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpp59\" (UniqueName: \"kubernetes.io/projected/2abd80d6-bb90-4d50-be83-22497de753b9-kube-api-access-xpp59\") pod \"migrator-955ffdf5f-vbx7b\" (UID: \"2abd80d6-bb90-4d50-be83-22497de753b9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"
Jun 09 02:22:53.504819 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.504321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpp59\" (UniqueName: \"kubernetes.io/projected/2abd80d6-bb90-4d50-be83-22497de753b9-kube-api-access-xpp59\") pod \"migrator-955ffdf5f-vbx7b\" (UID: \"2abd80d6-bb90-4d50-be83-22497de753b9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"
Jun 09 02:22:53.524163 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.524138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"
Jun 09 02:22:53.638836 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.638793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b"]
Jun 09 02:22:53.641351 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:22:53.641328    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abd80d6_bb90_4d50_be83_22497de753b9.slice/crio-d10361a7d1d953585520e010c45ec83056dcbdbd0f3f44569a748b97b165e4b1 WatchSource:0}: Error finding container d10361a7d1d953585520e010c45ec83056dcbdbd0f3f44569a748b97b165e4b1: Status 404 returned error can't find the container with id d10361a7d1d953585520e010c45ec83056dcbdbd0f3f44569a748b97b165e4b1
Jun 09 02:22:53.656861 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.656836    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-758bx_26354ed2-3f22-48d7-8f95-3dabdefe0281/dns-node-resolver/0.log"
Jun 09 02:22:53.976373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:53.976349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:22:54.481078 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:54.481049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b" event={"ID":"2abd80d6-bb90-4d50-be83-22497de753b9","Type":"ContainerStarted","Data":"d10361a7d1d953585520e010c45ec83056dcbdbd0f3f44569a748b97b165e4b1"}
Jun 09 02:22:54.657420 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:54.657393    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx8ql_11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3/node-ca/0.log"
Jun 09 02:22:55.457151 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:55.457076    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lwmp_933e1b22-dac8-43de-acbd-7848442bbde1/serve-healthcheck-canary/0.log"
Jun 09 02:22:55.485345 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:55.485315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b" event={"ID":"2abd80d6-bb90-4d50-be83-22497de753b9","Type":"ContainerStarted","Data":"45933c4774c96456f9a2701f9a926b4551c482ebcdb72ce08b1913da2b077184"}
Jun 09 02:22:55.485688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:55.485363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b" event={"ID":"2abd80d6-bb90-4d50-be83-22497de753b9","Type":"ContainerStarted","Data":"9ad68d20f48ed9064dc848be25398468cf6c4de5c2a077aaaf5b14ef745e7155"}
Jun 09 02:22:55.499563 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:55.499523    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vbx7b" podStartSLOduration=1.125839279 podStartE2EDuration="2.499509268s" totalImagesPullingTime="1.373669989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:55.499341339 +0000 UTC m=+172.973463003" watchObservedRunningTime="2026-06-09 02:22:55.499509268 +0000 UTC m=+172.973630922"
Jun 09 02:22:56.017334 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:56.017293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:22:56.017334 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:56.017334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:22:56.017363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017433    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017452    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d9c6fd8b-mtwt4: secret "image-registry-tls" not found
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017461    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017484    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:23:04.017464075 +0000 UTC m=+181.491585709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017511    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls podName:cdb209a3-6879-4acb-90aa-e9efb5287de7 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:04.017502729 +0000 UTC m=+181.491624360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls") pod "image-registry-59d9c6fd8b-mtwt4" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7") : secret "image-registry-tls" not found
Jun 09 02:22:56.017586 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:22:56.017525    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:23:04.017516831 +0000 UTC m=+181.491638463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : secret "router-metrics-certs-default" not found
Jun 09 02:23:04.075233 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.075186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:04.075585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.075272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:04.075585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.075291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:04.075585 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:04.075403    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle podName:f6a58053-2c7d-4c1f-8f18-cba5098b28ae nodeName:}" failed. No retries permitted until 2026-06-09 02:23:20.075389228 +0000 UTC m=+197.549510859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle") pod "router-default-c49cbd847-xhn2t" (UID: "f6a58053-2c7d-4c1f-8f18-cba5098b28ae") : configmap references non-existent config key: service-ca.crt
Jun 09 02:23:04.077555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.077531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"image-registry-59d9c6fd8b-mtwt4\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") " pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:04.077664 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.077535    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-metrics-certs\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:04.143699 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.143668    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mhf5x\""
Jun 09 02:23:04.151731 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.151714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:04.271159 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.271127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:23:04.274798 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:04.274769    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb209a3_6879_4acb_90aa_e9efb5287de7.slice/crio-831741d5d661122237bc076814f77a985e68a94bae3d7f3e8c748ca9312c6c69 WatchSource:0}: Error finding container 831741d5d661122237bc076814f77a985e68a94bae3d7f3e8c748ca9312c6c69: Status 404 returned error can't find the container with id 831741d5d661122237bc076814f77a985e68a94bae3d7f3e8c748ca9312c6c69
Jun 09 02:23:04.511468 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.511431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" event={"ID":"cdb209a3-6879-4acb-90aa-e9efb5287de7","Type":"ContainerStarted","Data":"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"}
Jun 09 02:23:04.511658 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.511483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" event={"ID":"cdb209a3-6879-4acb-90aa-e9efb5287de7","Type":"ContainerStarted","Data":"831741d5d661122237bc076814f77a985e68a94bae3d7f3e8c748ca9312c6c69"}
Jun 09 02:23:04.511658 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.511516    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:04.529764 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:04.529713    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" podStartSLOduration=16.529697969 podStartE2EDuration="16.529697969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:04.529197321 +0000 UTC m=+182.003318995" watchObservedRunningTime="2026-06-09 02:23:04.529697969 +0000 UTC m=+182.003819621"
Jun 09 02:23:16.718521 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.718491    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pwnfb"]
Jun 09 02:23:16.721154 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.721135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.724253 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.724230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 09 02:23:16.724391 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.724268    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 09 02:23:16.725671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.725653    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 09 02:23:16.725774 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.725684    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzznw\""
Jun 09 02:23:16.725774 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.725695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 09 02:23:16.734249 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.734229    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwnfb"]
Jun 09 02:23:16.763802 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.763776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.763931 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.763809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjczm\" (UniqueName: \"kubernetes.io/projected/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-api-access-jjczm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.763931 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.763840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38895731-1bea-43f8-8cff-c7d76b4451fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.764282 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.764253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38895731-1bea-43f8-8cff-c7d76b4451fc-data-volume\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.764404 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.764300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38895731-1bea-43f8-8cff-c7d76b4451fc-crio-socket\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.769086 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.769062    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:23:16.865381 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865381 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjczm\" (UniqueName: \"kubernetes.io/projected/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-api-access-jjczm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865604 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38895731-1bea-43f8-8cff-c7d76b4451fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865604 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38895731-1bea-43f8-8cff-c7d76b4451fc-data-volume\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865604 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38895731-1bea-43f8-8cff-c7d76b4451fc-crio-socket\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865702    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38895731-1bea-43f8-8cff-c7d76b4451fc-crio-socket\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865847    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38895731-1bea-43f8-8cff-c7d76b4451fc-data-volume\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.865993 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.865978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.867594 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.867574    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38895731-1bea-43f8-8cff-c7d76b4451fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:16.873073 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:16.873052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjczm\" (UniqueName: \"kubernetes.io/projected/38895731-1bea-43f8-8cff-c7d76b4451fc-kube-api-access-jjczm\") pod \"insights-runtime-extractor-pwnfb\" (UID: \"38895731-1bea-43f8-8cff-c7d76b4451fc\") " pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:17.030719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:17.030690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwnfb"
Jun 09 02:23:17.150542 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:17.150512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwnfb"]
Jun 09 02:23:17.153751 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:17.153728    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38895731_1bea_43f8_8cff_c7d76b4451fc.slice/crio-241b26442a4b2fff3ee810171f7701179d59f576bf17ed6c8e7c002b972ad50f WatchSource:0}: Error finding container 241b26442a4b2fff3ee810171f7701179d59f576bf17ed6c8e7c002b972ad50f: Status 404 returned error can't find the container with id 241b26442a4b2fff3ee810171f7701179d59f576bf17ed6c8e7c002b972ad50f
Jun 09 02:23:17.549405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:17.549366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwnfb" event={"ID":"38895731-1bea-43f8-8cff-c7d76b4451fc","Type":"ContainerStarted","Data":"114fe32db99f9fd4831b65bd7cb84c64b0e76fb17733c8033ca43be49446333c"}
Jun 09 02:23:17.549561 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:17.549428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwnfb" event={"ID":"38895731-1bea-43f8-8cff-c7d76b4451fc","Type":"ContainerStarted","Data":"241b26442a4b2fff3ee810171f7701179d59f576bf17ed6c8e7c002b972ad50f"}
Jun 09 02:23:18.554079 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:18.554040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwnfb" event={"ID":"38895731-1bea-43f8-8cff-c7d76b4451fc","Type":"ContainerStarted","Data":"5d1c49b382d4ff55274e2ad0af09462a8ea7a7ae96f915bbd3fcf7730588e1a3"}
Jun 09 02:23:19.559179 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:19.559143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwnfb" event={"ID":"38895731-1bea-43f8-8cff-c7d76b4451fc","Type":"ContainerStarted","Data":"4d3535e0a069681b917995d9d47e7b7fcbbd90c6f230efc5ce42bf48136c4fed"}
Jun 09 02:23:19.576928 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:19.576828    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pwnfb" podStartSLOduration=1.525913201 podStartE2EDuration="3.57681293s" totalImagesPullingTime="2.050899729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:19.575040337 +0000 UTC m=+197.049161991" watchObservedRunningTime="2026-06-09 02:23:19.57681293 +0000 UTC m=+197.050934582"
Jun 09 02:23:20.090291 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.090256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:20.090787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.090770    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a58053-2c7d-4c1f-8f18-cba5098b28ae-service-ca-bundle\") pod \"router-default-c49cbd847-xhn2t\" (UID: \"f6a58053-2c7d-4c1f-8f18-cba5098b28ae\") " pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:20.335302 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.335275    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-754xh\""
Jun 09 02:23:20.343373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.343329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:20.482967 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.482937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c49cbd847-xhn2t"]
Jun 09 02:23:20.486015 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:20.485991    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a58053_2c7d_4c1f_8f18_cba5098b28ae.slice/crio-951d1f7529c33b46c77b14da8bbcec0491fd10688fc2c0d60dcc0a7b1610d280 WatchSource:0}: Error finding container 951d1f7529c33b46c77b14da8bbcec0491fd10688fc2c0d60dcc0a7b1610d280: Status 404 returned error can't find the container with id 951d1f7529c33b46c77b14da8bbcec0491fd10688fc2c0d60dcc0a7b1610d280
Jun 09 02:23:20.564592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.564556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c49cbd847-xhn2t" event={"ID":"f6a58053-2c7d-4c1f-8f18-cba5098b28ae","Type":"ContainerStarted","Data":"5f8f961f5f6b06b9f251f3a239b0891132160b5fecc50c89cd2e9137f72399bc"}
Jun 09 02:23:20.565001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.564617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c49cbd847-xhn2t" event={"ID":"f6a58053-2c7d-4c1f-8f18-cba5098b28ae","Type":"ContainerStarted","Data":"951d1f7529c33b46c77b14da8bbcec0491fd10688fc2c0d60dcc0a7b1610d280"}
Jun 09 02:23:20.583556 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:20.583505    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c49cbd847-xhn2t" podStartSLOduration=32.583491379 podStartE2EDuration="32.583491379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:20.582856561 +0000 UTC m=+198.056978214" watchObservedRunningTime="2026-06-09 02:23:20.583491379 +0000 UTC m=+198.057613032"
Jun 09 02:23:21.344433 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:21.344396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:21.346806 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:21.346782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:21.567235 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:21.567206    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:21.568449 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:21.568432    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c49cbd847-xhn2t"
Jun 09 02:23:23.011447 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.011412    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"]
Jun 09 02:23:23.014414 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.014398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:23.016793 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.016775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jmzm6\""
Jun 09 02:23:23.016860 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.016805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 09 02:23:23.021359 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.021339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"]
Jun 09 02:23:23.112587 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.112558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-x9qp7\" (UID: \"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:23.213519 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.213487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-x9qp7\" (UID: \"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:23.213663 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:23.213605    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 09 02:23:23.213704 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:23.213664    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates podName:c78dbdc6-74a9-45b6-bc5a-d73e2ef84826 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:23.713649875 +0000 UTC m=+201.187771506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-x9qp7" (UID: "c78dbdc6-74a9-45b6-bc5a-d73e2ef84826") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 09 02:23:23.718789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.718756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-x9qp7\" (UID: \"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:23.721042 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.721013    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c78dbdc6-74a9-45b6-bc5a-d73e2ef84826-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-x9qp7\" (UID: \"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:23.923286 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:23.923253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:24.038997 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:24.038969    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"]
Jun 09 02:23:24.041517 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:24.041492    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78dbdc6_74a9_45b6_bc5a_d73e2ef84826.slice/crio-b0ec465943c6f8998a4dc036a1e554b01f1584d0ae6004336b31caaf901a08ca WatchSource:0}: Error finding container b0ec465943c6f8998a4dc036a1e554b01f1584d0ae6004336b31caaf901a08ca: Status 404 returned error can't find the container with id b0ec465943c6f8998a4dc036a1e554b01f1584d0ae6004336b31caaf901a08ca
Jun 09 02:23:24.577202 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:24.577168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7" event={"ID":"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826","Type":"ContainerStarted","Data":"b0ec465943c6f8998a4dc036a1e554b01f1584d0ae6004336b31caaf901a08ca"}
Jun 09 02:23:25.581079 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:25.581047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7" event={"ID":"c78dbdc6-74a9-45b6-bc5a-d73e2ef84826","Type":"ContainerStarted","Data":"924dbbff15f97930ef48b16b0dc6806980ed1a847da1e3f2347db903f75e596a"}
Jun 09 02:23:25.581455 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:25.581123    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:25.585807 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:25.585787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7"
Jun 09 02:23:25.595639 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:25.595598    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-x9qp7" podStartSLOduration=2.444445055 podStartE2EDuration="3.595585077s" totalImagesPullingTime="1.151140022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:25.594828621 +0000 UTC m=+203.068950273" watchObservedRunningTime="2026-06-09 02:23:25.595585077 +0000 UTC m=+203.069706749"
Jun 09 02:23:26.774745 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:26.774713    2576 patch_prober.go:28] interesting pod/image-registry-59d9c6fd8b-mtwt4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 02:23:26.775126 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:26.774762    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 02:23:34.248148 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.248111    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:23:34.251276 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.251259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.253797 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.253774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 09 02:23:34.253953 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.253780    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 09 02:23:34.255111 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255093    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 09 02:23:34.255213 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255134    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 09 02:23:34.255213 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255190    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 09 02:23:34.255213 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255094    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kvtl6\""
Jun 09 02:23:34.255213 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255207    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 09 02:23:34.255409 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.255278    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 09 02:23:34.259535 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.259516    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 09 02:23:34.260909 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.260878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:23:34.299653 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299653 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299825 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299825 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w476d\" (UniqueName: \"kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299825 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299825 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.299994 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.299826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400331 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400331 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w476d\" (UniqueName: \"kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.400515 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.400435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.401138 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.401117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.401228 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.401113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.401272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.401236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.401306 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.401282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.402875 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.402853    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.402968 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.402883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.407616 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.407594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w476d\" (UniqueName: \"kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d\") pod \"console-5669d8875f-xbhw6\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") " pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.560051 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.559978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:34.677733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:34.677701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:23:34.680419 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:34.680389    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f5438f_bd57_4b49_b389_94a3b33c1457.slice/crio-988216f220dc9c7019a6e858aed32e65800c468072c319682f1be4f993c432a8 WatchSource:0}: Error finding container 988216f220dc9c7019a6e858aed32e65800c468072c319682f1be4f993c432a8: Status 404 returned error can't find the container with id 988216f220dc9c7019a6e858aed32e65800c468072c319682f1be4f993c432a8
Jun 09 02:23:35.612958 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:35.612923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669d8875f-xbhw6" event={"ID":"f6f5438f-bd57-4b49-b389-94a3b33c1457","Type":"ContainerStarted","Data":"988216f220dc9c7019a6e858aed32e65800c468072c319682f1be4f993c432a8"}
Jun 09 02:23:36.774823 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:36.774782    2576 patch_prober.go:28] interesting pod/image-registry-59d9c6fd8b-mtwt4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 02:23:36.775247 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:36.774839    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 02:23:37.421164 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.421130    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"]
Jun 09 02:23:37.427319 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.427290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.430403 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.430368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 09 02:23:37.430749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.430726    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 09 02:23:37.430869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.430754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-msjrn\""
Jun 09 02:23:37.430869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.430726    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 09 02:23:37.431778 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.431759    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 09 02:23:37.431868 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.431764    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 09 02:23:37.433624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.433604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"]
Jun 09 02:23:37.436976 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.436955    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9mlz4"]
Jun 09 02:23:37.440295 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.440265    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.443544 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.443528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 09 02:23:37.444120 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.444102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bstpg\""
Jun 09 02:23:37.444467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.444445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 09 02:23:37.444863 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.444845    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 09 02:23:37.525211 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-sys\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525399 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4t88\" (UniqueName: \"kubernetes.io/projected/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-kube-api-access-k4t88\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.525399 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525399 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-textfile\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525399 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7msb\" (UniqueName: \"kubernetes.io/projected/e62c94ee-75fd-4617-a63f-56d365194e66-kube-api-access-f7msb\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-root\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.525662 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-metrics-client-ca\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.525956 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.525695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-wtmp\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626081 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4t88\" (UniqueName: \"kubernetes.io/projected/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-kube-api-access-k4t88\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.626081 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-textfile\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7msb\" (UniqueName: \"kubernetes.io/projected/e62c94ee-75fd-4617-a63f-56d365194e66-kube-api-access-f7msb\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-root\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:37.626207    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-metrics-client-ca\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:37.626377    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls podName:e62c94ee-75fd-4617-a63f-56d365194e66 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:38.12635751 +0000 UTC m=+215.600479143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls") pod "node-exporter-9mlz4" (UID: "e62c94ee-75fd-4617-a63f-56d365194e66") : secret "node-exporter-tls" not found
Jun 09 02:23:37.626411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-wtmp\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-sys\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-textfile\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626567    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-sys\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-root\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.626605    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-wtmp\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627339 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.627105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627339 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.627185    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62c94ee-75fd-4617-a63f-56d365194e66-metrics-client-ca\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.627480 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.627348    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.629157 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.629117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.629390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.629372    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.629459 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.629402    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.641308 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.641282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7msb\" (UniqueName: \"kubernetes.io/projected/e62c94ee-75fd-4617-a63f-56d365194e66-kube-api-access-f7msb\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:37.641423 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.641392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4t88\" (UniqueName: \"kubernetes.io/projected/294b6a7c-d108-4ff7-9512-8d6ee39ccb13-kube-api-access-k4t88\") pod \"openshift-state-metrics-65f78d5c66-2mrj7\" (UID: \"294b6a7c-d108-4ff7-9512-8d6ee39ccb13\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:37.739174 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:37.739134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"
Jun 09 02:23:38.132408 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.132382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:38.134991 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.134969    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e62c94ee-75fd-4617-a63f-56d365194e66-node-exporter-tls\") pod \"node-exporter-9mlz4\" (UID: \"e62c94ee-75fd-4617-a63f-56d365194e66\") " pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:38.176466 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.176438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7"]
Jun 09 02:23:38.178419 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:38.178398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294b6a7c_d108_4ff7_9512_8d6ee39ccb13.slice/crio-b63a5cbe8a2678039c7b9d2706ddf87e7eedecb80245295dbc926fda3577cbee WatchSource:0}: Error finding container b63a5cbe8a2678039c7b9d2706ddf87e7eedecb80245295dbc926fda3577cbee: Status 404 returned error can't find the container with id b63a5cbe8a2678039c7b9d2706ddf87e7eedecb80245295dbc926fda3577cbee
Jun 09 02:23:38.350470 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.350401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9mlz4"
Jun 09 02:23:38.359487 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:38.359459    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62c94ee_75fd_4617_a63f_56d365194e66.slice/crio-1f51c53194b4c210138518df6b39db01056067831167a57a93ef6c7aebc26f0d WatchSource:0}: Error finding container 1f51c53194b4c210138518df6b39db01056067831167a57a93ef6c7aebc26f0d: Status 404 returned error can't find the container with id 1f51c53194b4c210138518df6b39db01056067831167a57a93ef6c7aebc26f0d
Jun 09 02:23:38.493856 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.493826    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:23:38.496547 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.496529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.499088 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 09 02:23:38.499215 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499094    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 09 02:23:38.499215 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499094    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 09 02:23:38.499215 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 09 02:23:38.499352 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499294    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 09 02:23:38.499393 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 09 02:23:38.499562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499537    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 09 02:23:38.499673 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499588    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 09 02:23:38.499673 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499607    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 09 02:23:38.499673 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.499613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5v276\""
Jun 09 02:23:38.512786 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.512766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:23:38.623956 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.623862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mlz4" event={"ID":"e62c94ee-75fd-4617-a63f-56d365194e66","Type":"ContainerStarted","Data":"1f51c53194b4c210138518df6b39db01056067831167a57a93ef6c7aebc26f0d"}
Jun 09 02:23:38.625497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.625474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7" event={"ID":"294b6a7c-d108-4ff7-9512-8d6ee39ccb13","Type":"ContainerStarted","Data":"20658282e6e9472cf5905c5adb68113688cfebdbee4b5125607e7bcba5a5a760"}
Jun 09 02:23:38.625597 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.625517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7" event={"ID":"294b6a7c-d108-4ff7-9512-8d6ee39ccb13","Type":"ContainerStarted","Data":"b47b4f640a57373cced1926923d94c221c96fad7d9d96bbfb6b6a71b71d194bd"}
Jun 09 02:23:38.625597 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.625544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7" event={"ID":"294b6a7c-d108-4ff7-9512-8d6ee39ccb13","Type":"ContainerStarted","Data":"b63a5cbe8a2678039c7b9d2706ddf87e7eedecb80245295dbc926fda3577cbee"}
Jun 09 02:23:38.626757 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.626734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669d8875f-xbhw6" event={"ID":"f6f5438f-bd57-4b49-b389-94a3b33c1457","Type":"ContainerStarted","Data":"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"}
Jun 09 02:23:38.635976 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.635949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.635993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636211 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636211 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636211 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs59q\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636211 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.636396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.636355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.643043 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.643007    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5669d8875f-xbhw6" podStartSLOduration=1.211009668 podStartE2EDuration="4.642994448s" totalImagesPullingTime="3.43198478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:38.642408973 +0000 UTC m=+216.116530618" watchObservedRunningTime="2026-06-09 02:23:38.642994448 +0000 UTC m=+216.117116100"
Jun 09 02:23:38.737625 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs59q\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.737847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.737989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.738016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.738067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.738197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.738096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.739676 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.738734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.739676 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:38.739087    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 09 02:23:38.739676 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:38.739156    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls podName:4266ad04-6bae-425f-8a60-ca67f4054ccc nodeName:}" failed. No retries permitted until 2026-06-09 02:23:39.239135025 +0000 UTC m=+216.713256671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc") : secret "alertmanager-main-tls" not found
Jun 09 02:23:38.739676 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.739460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.740104 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.740072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.740839 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.740812    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.741084 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.741065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.741292 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.741272    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.741350 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.741332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.741547 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.741506    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.742042 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.742019    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.742250 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.742235    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.742376 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.742354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:38.744857 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:38.744838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs59q\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:39.243848 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:39.243813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:39.244235 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:39.243948    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 09 02:23:39.244235 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:39.244009    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls podName:4266ad04-6bae-425f-8a60-ca67f4054ccc nodeName:}" failed. No retries permitted until 2026-06-09 02:23:40.243995249 +0000 UTC m=+217.718116880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc") : secret "alertmanager-main-tls" not found
Jun 09 02:23:39.632166 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:39.632129    2576 generic.go:356] "Generic (PLEG): container finished" podID="e62c94ee-75fd-4617-a63f-56d365194e66" containerID="4256e467a4bd249541473285d79ce8a3dea3efc8bf5ea0eb7221abb3ecc988e5" exitCode=0
Jun 09 02:23:39.632289 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:39.632217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mlz4" event={"ID":"e62c94ee-75fd-4617-a63f-56d365194e66","Type":"ContainerDied","Data":"4256e467a4bd249541473285d79ce8a3dea3efc8bf5ea0eb7221abb3ecc988e5"}
Jun 09 02:23:39.634186 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:39.634165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7" event={"ID":"294b6a7c-d108-4ff7-9512-8d6ee39ccb13","Type":"ContainerStarted","Data":"d16519cedb0fb0695df077267dbae007b54de60be4ba1cbab7fb374776d42ffd"}
Jun 09 02:23:39.667456 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:39.667414    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2mrj7" podStartSLOduration=1.5008610199999999 podStartE2EDuration="2.667396884s" totalImagesPullingTime="1.166535864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:39.665915257 +0000 UTC m=+217.140036920" watchObservedRunningTime="2026-06-09 02:23:39.667396884 +0000 UTC m=+217.141518537"
Jun 09 02:23:40.253565 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.253527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:40.255961 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.255938    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:40.305832 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.305795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:23:40.452445 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.452415    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:23:40.453260 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:40.453238    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4266ad04_6bae_425f_8a60_ca67f4054ccc.slice/crio-7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00 WatchSource:0}: Error finding container 7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00: Status 404 returned error can't find the container with id 7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00
Jun 09 02:23:40.639298 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.639206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mlz4" event={"ID":"e62c94ee-75fd-4617-a63f-56d365194e66","Type":"ContainerStarted","Data":"4fa3a48919e69c4ae6f06dfde2539a3f895733c889f25c6bc5d776a7ba533951"}
Jun 09 02:23:40.639298 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.639262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mlz4" event={"ID":"e62c94ee-75fd-4617-a63f-56d365194e66","Type":"ContainerStarted","Data":"4a57173153b2a93f04e033c670f4a0710c0d1ca464d229f748aaa8795d088fbb"}
Jun 09 02:23:40.640269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.640241    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00"}
Jun 09 02:23:40.655966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:40.655860    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9mlz4" podStartSLOduration=2.500919873 podStartE2EDuration="3.655846357s" totalImagesPullingTime="1.091447164s" totalInitContainerRuntime="63.47932ms" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:40.654927279 +0000 UTC m=+218.129048929" watchObservedRunningTime="2026-06-09 02:23:40.655846357 +0000 UTC m=+218.129968008"
Jun 09 02:23:41.647063 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.647010    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="2b64034bb27ba8a438e0dc3af2e347018507a246195e10d4e8243ba54be42519" exitCode=0
Jun 09 02:23:41.647419 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.647100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"2b64034bb27ba8a438e0dc3af2e347018507a246195e10d4e8243ba54be42519"}
Jun 09 02:23:41.734652 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.734624    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"]
Jun 09 02:23:41.737816 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.737800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.740261 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c8zst\""
Jun 09 02:23:41.740592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 09 02:23:41.740679 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8n3h96hp5n9on\""
Jun 09 02:23:41.740739 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740677    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 09 02:23:41.740867 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740852    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 09 02:23:41.740972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.740929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 09 02:23:41.746780 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.746762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"]
Jun 09 02:23:41.788090 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.788049    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry" containerID="cri-o://cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63" gracePeriod=30
Jun 09 02:23:41.870083 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-client-certs\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0dae03d-2873-4005-838f-ee960f835e16-audit-log\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-metrics-server-audit-profiles\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-client-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870350 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-tls\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.870350 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.870284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhm5v\" (UniqueName: \"kubernetes.io/projected/d0dae03d-2873-4005-838f-ee960f835e16-kube-api-access-vhm5v\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-tls\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhm5v\" (UniqueName: \"kubernetes.io/projected/d0dae03d-2873-4005-838f-ee960f835e16-kube-api-access-vhm5v\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-client-certs\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0dae03d-2873-4005-838f-ee960f835e16-audit-log\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971956 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-metrics-server-audit-profiles\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.971956 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.971798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-client-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.972332 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.972303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.972427 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.972374    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0dae03d-2873-4005-838f-ee960f835e16-audit-log\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.972921 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.972879    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0dae03d-2873-4005-838f-ee960f835e16-metrics-server-audit-profiles\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.974117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.974091    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-tls\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.974204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.974181    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-client-ca-bundle\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.974281 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.974262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0dae03d-2873-4005-838f-ee960f835e16-secret-metrics-server-client-certs\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:41.979110 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:41.979088    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhm5v\" (UniqueName: \"kubernetes.io/projected/d0dae03d-2873-4005-838f-ee960f835e16-kube-api-access-vhm5v\") pod \"metrics-server-5d7fcbc986-xpmzs\" (UID: \"d0dae03d-2873-4005-838f-ee960f835e16\") " pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:42.022970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.022949    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:42.047115 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.047090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:23:42.174332 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174295    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76d4l\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174707 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174517    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174707 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.174707 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.174605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") pod \"cdb209a3-6879-4acb-90aa-e9efb5287de7\" (UID: \"cdb209a3-6879-4acb-90aa-e9efb5287de7\") "
Jun 09 02:23:42.175623 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.175585    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:23:42.175854 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.175823    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:23:42.177666 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.177640    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:23:42.177759 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.177737    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:23:42.177934 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.177911    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l" (OuterVolumeSpecName: "kube-api-access-76d4l") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "kube-api-access-76d4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:23:42.178020 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.177959    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:23:42.179943 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.179913    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:23:42.187174 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.187145    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cdb209a3-6879-4acb-90aa-e9efb5287de7" (UID: "cdb209a3-6879-4acb-90aa-e9efb5287de7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:23:42.209352 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.209327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"]
Jun 09 02:23:42.211872 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:42.211845    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dae03d_2873_4005_838f_ee960f835e16.slice/crio-e46420fb622a64741f415d0ce2f163f8adafd3f387ce07dcb893ee1dddbe2e23 WatchSource:0}: Error finding container e46420fb622a64741f415d0ce2f163f8adafd3f387ce07dcb893ee1dddbe2e23: Status 404 returned error can't find the container with id e46420fb622a64741f415d0ce2f163f8adafd3f387ce07dcb893ee1dddbe2e23
Jun 09 02:23:42.226345 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.226325    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"]
Jun 09 02:23:42.226670 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.226655    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry"
Jun 09 02:23:42.226734 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.226674    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry"
Jun 09 02:23:42.226769 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.226739    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerName="registry"
Jun 09 02:23:42.231370 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.231349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.234624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.234602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 09 02:23:42.234720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.234655    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k784k\""
Jun 09 02:23:42.239522 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.239498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"]
Jun 09 02:23:42.250007 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.249981    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:23:42.254247 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.254225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.262267 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.262245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:23:42.275610 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275591    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-certificates\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275614    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275628    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76d4l\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-kube-api-access-76d4l\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275640    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb209a3-6879-4acb-90aa-e9efb5287de7-trusted-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275654    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-image-registry-private-configuration\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275663    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb209a3-6879-4acb-90aa-e9efb5287de7-bound-sa-token\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275671    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb209a3-6879-4acb-90aa-e9efb5287de7-installation-pull-secrets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.275720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.275681    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb209a3-6879-4acb-90aa-e9efb5287de7-ca-trust-extracted\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:23:42.376518 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376679 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.376679 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6692h\" (UniqueName: \"kubernetes.io/projected/61f8f75f-a25a-45c2-8004-c68a42f746d6-kube-api-access-6692h\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.376791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376992 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbpl\" (UniqueName: \"kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.376992 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.376850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.477688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.477688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.477688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.477885 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.477885 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:42.477757    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 09 02:23:42.477885 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:42.477804    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert podName:61f8f75f-a25a-45c2-8004-c68a42f746d6 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:42.977789935 +0000 UTC m=+220.451911566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-hw6fs" (UID: "61f8f75f-a25a-45c2-8004-c68a42f746d6") : secret "monitoring-plugin-cert" not found
Jun 09 02:23:42.477885 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.477885 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6692h\" (UniqueName: \"kubernetes.io/projected/61f8f75f-a25a-45c2-8004-c68a42f746d6-kube-api-access-6692h\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.478140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.477986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbpl\" (UniqueName: \"kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.478556    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.478621    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.478634    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.478688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.478667    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.480530 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.480510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.480611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.480532    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.488188 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.488168    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6692h\" (UniqueName: \"kubernetes.io/projected/61f8f75f-a25a-45c2-8004-c68a42f746d6-kube-api-access-6692h\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.488252 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.488237    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbpl\" (UniqueName: \"kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl\") pod \"console-8b56b6876-48bwm\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") " pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.564525 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.564485    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:42.654626 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.654582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs" event={"ID":"d0dae03d-2873-4005-838f-ee960f835e16","Type":"ContainerStarted","Data":"e46420fb622a64741f415d0ce2f163f8adafd3f387ce07dcb893ee1dddbe2e23"}
Jun 09 02:23:42.656824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.656029    2576 generic.go:356] "Generic (PLEG): container finished" podID="cdb209a3-6879-4acb-90aa-e9efb5287de7" containerID="cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63" exitCode=0
Jun 09 02:23:42.656824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.656105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" event={"ID":"cdb209a3-6879-4acb-90aa-e9efb5287de7","Type":"ContainerDied","Data":"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"}
Jun 09 02:23:42.656824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.656147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4" event={"ID":"cdb209a3-6879-4acb-90aa-e9efb5287de7","Type":"ContainerDied","Data":"831741d5d661122237bc076814f77a985e68a94bae3d7f3e8c748ca9312c6c69"}
Jun 09 02:23:42.656824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.656175    2576 scope.go:117] "RemoveContainer" containerID="cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"
Jun 09 02:23:42.656824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.656332    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"
Jun 09 02:23:42.679910 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.679866    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:23:42.685469 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.685445    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59d9c6fd8b-mtwt4"]
Jun 09 02:23:42.693107 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.693085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:23:42.983405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.983370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:42.984016 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.983876    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb209a3-6879-4acb-90aa-e9efb5287de7" path="/var/lib/kubelet/pods/cdb209a3-6879-4acb-90aa-e9efb5287de7/volumes"
Jun 09 02:23:42.986478 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:42.986437    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f8f75f-a25a-45c2-8004-c68a42f746d6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-hw6fs\" (UID: \"61f8f75f-a25a-45c2-8004-c68a42f746d6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:43.014640 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:43.014610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc59f4d_da86_442b_9c5a_8a9934d9db20.slice/crio-7bf4d02e1c66a39c79beee9864214b02e717d8955f27ca9f1774861712b05ffd WatchSource:0}: Error finding container 7bf4d02e1c66a39c79beee9864214b02e717d8955f27ca9f1774861712b05ffd: Status 404 returned error can't find the container with id 7bf4d02e1c66a39c79beee9864214b02e717d8955f27ca9f1774861712b05ffd
Jun 09 02:23:43.017362 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.017340    2576 scope.go:117] "RemoveContainer" containerID="cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"
Jun 09 02:23:43.017705 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:23:43.017622    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63\": container with ID starting with cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63 not found: ID does not exist" containerID="cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"
Jun 09 02:23:43.017705 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.017659    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63"} err="failed to get container status \"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63\": rpc error: code = NotFound desc = could not find container \"cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63\": container with ID starting with cec05a4083baf7c4142df674dbbf1328b6534cffae609bd207edecfbaa4d4e63 not found: ID does not exist"
Jun 09 02:23:43.142316 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.142287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:43.594789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.594760    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:23:43.598735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.598714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.601841 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.601440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 09 02:23:43.601841 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.601465    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 09 02:23:43.601841 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.601774    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 09 02:23:43.601841 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.601795    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.602959    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603167    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603522    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7diuo5to974mm\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603693    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603777    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rn7gr\""
Jun 09 02:23:43.603971 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.603853    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 09 02:23:43.604328 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.604101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 09 02:23:43.604328 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.604326    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 09 02:23:43.605284 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.604850    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 09 02:23:43.605284 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.605012    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 09 02:23:43.606828 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.606643    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 09 02:23:43.613823 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.613801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:23:43.627306 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.627281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"]
Jun 09 02:23:43.630097 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:43.630060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f8f75f_a25a_45c2_8004_c68a42f746d6.slice/crio-f0264cb4df030e354ec22763e737c4b457061665f244466dfaee8ebd5ea707f0 WatchSource:0}: Error finding container f0264cb4df030e354ec22763e737c4b457061665f244466dfaee8ebd5ea707f0: Status 404 returned error can't find the container with id f0264cb4df030e354ec22763e737c4b457061665f244466dfaee8ebd5ea707f0
Jun 09 02:23:43.661326 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.661295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs" event={"ID":"61f8f75f-a25a-45c2-8004-c68a42f746d6","Type":"ContainerStarted","Data":"f0264cb4df030e354ec22763e737c4b457061665f244466dfaee8ebd5ea707f0"}
Jun 09 02:23:43.663094 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.663064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs" event={"ID":"d0dae03d-2873-4005-838f-ee960f835e16","Type":"ContainerStarted","Data":"e6d953329fc7f3655148da8fea4a2f79f5d8f352598a9ec1965afeaf9e94d4a7"}
Jun 09 02:23:43.664728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.664701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b6876-48bwm" event={"ID":"1cc59f4d-da86-442b-9c5a-8a9934d9db20","Type":"ContainerStarted","Data":"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"}
Jun 09 02:23:43.664869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.664752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b6876-48bwm" event={"ID":"1cc59f4d-da86-442b-9c5a-8a9934d9db20","Type":"ContainerStarted","Data":"7bf4d02e1c66a39c79beee9864214b02e717d8955f27ca9f1774861712b05ffd"}
Jun 09 02:23:43.668302 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.668283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"ecdd55cacba3ac1513888fa118eaff3c40b2f443cbdbbb6cb60a2cd5f4611134"}
Jun 09 02:23:43.668382 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.668336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"be48336dc01528ff77feaf9a1e3cd7bef54140a35f213963f37003d46c225579"}
Jun 09 02:23:43.681208 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.681120    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs" podStartSLOduration=1.348686786 podStartE2EDuration="2.681100371s" totalImagesPullingTime="1.332413585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:43.679204964 +0000 UTC m=+221.153326617" watchObservedRunningTime="2026-06-09 02:23:43.681100371 +0000 UTC m=+221.155222026"
Jun 09 02:23:43.690663 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690753 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690753 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690836 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690836 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690836 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690973 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.690973 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.690876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691151 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56lgn\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.691874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.691530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.695751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.695712    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b56b6876-48bwm" podStartSLOduration=1.69570094 podStartE2EDuration="1.69570094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:43.69451924 +0000 UTC m=+221.168640892" watchObservedRunningTime="2026-06-09 02:23:43.69570094 +0000 UTC m=+221.169822592"
Jun 09 02:23:43.792856 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.792828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.792982 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.792966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.793555 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.793804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56lgn\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794136 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.794063    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.794550 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.794342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.797024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.797168    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.797557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.797852    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.798086    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.798466 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.798449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.799690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.799690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799076    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.799690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.799690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.799690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.800009 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.799810    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.800480 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.800231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.800958 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.800934    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.801037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.800981    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.801204 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.801187    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.801951 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.801932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56lgn\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn\") pod \"prometheus-k8s-0\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:43.915105 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:43.915077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:23:44.047528 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.047455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:23:44.050002 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:23:44.049954    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260d977d_87e5_43b0_baac_aa3b4261ea67.slice/crio-b9d6a3201d8f9ffef86a86c349eaab66fb97ea9b0321b3caff21e460476c8d0a WatchSource:0}: Error finding container b9d6a3201d8f9ffef86a86c349eaab66fb97ea9b0321b3caff21e460476c8d0a: Status 404 returned error can't find the container with id b9d6a3201d8f9ffef86a86c349eaab66fb97ea9b0321b3caff21e460476c8d0a
Jun 09 02:23:44.560663 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.560634    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:44.560787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.560687    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:23:44.562005 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.561958    2576 patch_prober.go:28] interesting pod/console-5669d8875f-xbhw6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 09 02:23:44.562109 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.562005    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5669d8875f-xbhw6" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 09 02:23:44.674763 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.674730    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63" exitCode=0
Jun 09 02:23:44.675230 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.674881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"}
Jun 09 02:23:44.675230 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.675016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"b9d6a3201d8f9ffef86a86c349eaab66fb97ea9b0321b3caff21e460476c8d0a"}
Jun 09 02:23:44.678953 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.678923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"2800e44e2d87c5b7e6a7ce75793691e2dfb7a8ac98885802e632a7ff5782389b"}
Jun 09 02:23:44.679059 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.678991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"060235b66dfadc9a382c718e2d42282065edd36576346559a3c5c9669cd62c88"}
Jun 09 02:23:44.679059 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.679018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"a3bfcc1dabf5bb91df782c26fac8a90e86892faec50ec48dbfb28ff7f062d3cc"}
Jun 09 02:23:44.679059 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.679056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerStarted","Data":"638f50725e7c1395a248aaf46a4327569dd38b46c0671160aced035a358be362"}
Jun 09 02:23:44.725281 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:44.725233    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.568537504 podStartE2EDuration="6.725219667s" totalImagesPullingTime="3.139281812s" totalInitContainerRuntime="17.400351ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:44.723363461 +0000 UTC m=+222.197485150" watchObservedRunningTime="2026-06-09 02:23:44.725219667 +0000 UTC m=+222.199341320"
Jun 09 02:23:45.684717 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:45.684680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs" event={"ID":"61f8f75f-a25a-45c2-8004-c68a42f746d6","Type":"ContainerStarted","Data":"10f7c4df0ffb92982f653a0f4320b627859d80a1fcae75534b63a6c8226139e2"}
Jun 09 02:23:45.685207 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:45.684747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:45.689921 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:45.689886    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs"
Jun 09 02:23:45.699000 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:45.698951    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-hw6fs" podStartSLOduration=2.204892967 podStartE2EDuration="3.698935092s" totalImagesPullingTime="1.494042125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:45.698467676 +0000 UTC m=+223.172589328" watchObservedRunningTime="2026-06-09 02:23:45.698935092 +0000 UTC m=+223.173056746"
Jun 09 02:23:47.701860 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:47.701821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"}
Jun 09 02:23:47.702480 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:47.702458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"}
Jun 09 02:23:49.333564 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.333537    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:23:49.712140 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.712109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"}
Jun 09 02:23:49.712308 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.712170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"}
Jun 09 02:23:49.712308 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.712195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"}
Jun 09 02:23:49.712308 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.712223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerStarted","Data":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"}
Jun 09 02:23:49.743026 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:49.742966    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.339312633 podStartE2EDuration="6.742947179s" totalImagesPullingTime="4.385048625s" totalInitContainerRuntime="18.585921ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:49.742316252 +0000 UTC m=+227.216437906" watchObservedRunningTime="2026-06-09 02:23:49.742947179 +0000 UTC m=+227.217068843"
Jun 09 02:23:52.564759 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:52.564730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:52.565149 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:52.564823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:23:52.566095 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:52.566073    2576 patch_prober.go:28] interesting pod/console-8b56b6876-48bwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jun 09 02:23:52.566196 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:52.566111    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jun 09 02:23:53.916054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:23:53.916010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:24:02.047232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.047190    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:24:02.047595 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.047257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:24:02.564912 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.564864    2576 patch_prober.go:28] interesting pod/console-8b56b6876-48bwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jun 09 02:24:02.565038 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.564937    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jun 09 02:24:02.757734 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.757702    2576 generic.go:356] "Generic (PLEG): container finished" podID="9593550b-97a8-499a-be99-2bf5fc294a24" containerID="2b5c2bba30ddf3d9d4253f446ea07fb852d9f2d54122cbe877beee96b0b807b0" exitCode=0
Jun 09 02:24:02.757940 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.757779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w" event={"ID":"9593550b-97a8-499a-be99-2bf5fc294a24","Type":"ContainerDied","Data":"2b5c2bba30ddf3d9d4253f446ea07fb852d9f2d54122cbe877beee96b0b807b0"}
Jun 09 02:24:02.758131 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:02.758116    2576 scope.go:117] "RemoveContainer" containerID="2b5c2bba30ddf3d9d4253f446ea07fb852d9f2d54122cbe877beee96b0b807b0"
Jun 09 02:24:03.763648 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:03.763612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-kpg9w" event={"ID":"9593550b-97a8-499a-be99-2bf5fc294a24","Type":"ContainerStarted","Data":"41ab420c135f25d7c140baa070bf083a8d56b45d3be17422386f99506b6529d5"}
Jun 09 02:24:12.565124 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:12.565084    2576 patch_prober.go:28] interesting pod/console-8b56b6876-48bwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jun 09 02:24:12.565488 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:12.565149    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jun 09 02:24:14.356013 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:14.355972    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5669d8875f-xbhw6" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerName="console" containerID="cri-o://f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7" gracePeriod=15
Jun 09 02:24:14.761439 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:14.761406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:24:14.763592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:14.763571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e70df090-e6a8-49c3-a22f-25e688e969a6-metrics-certs\") pod \"network-metrics-daemon-gnvkg\" (UID: \"e70df090-e6a8-49c3-a22f-25e688e969a6\") " pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:24:14.980972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:14.980945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\""
Jun 09 02:24:14.987942 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:14.987926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnvkg"
Jun 09 02:24:15.045288 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.045237    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/init-config-reloader/0.log"
Jun 09 02:24:15.134735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.134713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnvkg"]
Jun 09 02:24:15.136818 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:24:15.136791    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70df090_e6a8_49c3_a22f_25e688e969a6.slice/crio-90b6b50d8dcb06dad6553c1c658b989768e70d18e8ad3b6d8dbfa8c28ff595b6 WatchSource:0}: Error finding container 90b6b50d8dcb06dad6553c1c658b989768e70d18e8ad3b6d8dbfa8c28ff595b6: Status 404 returned error can't find the container with id 90b6b50d8dcb06dad6553c1c658b989768e70d18e8ad3b6d8dbfa8c28ff595b6
Jun 09 02:24:15.245278 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.245249    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/alertmanager/0.log"
Jun 09 02:24:15.445871 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.445783    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/config-reloader/0.log"
Jun 09 02:24:15.644932 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.644883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/kube-rbac-proxy-web/0.log"
Jun 09 02:24:15.808505 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.808475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnvkg" event={"ID":"e70df090-e6a8-49c3-a22f-25e688e969a6","Type":"ContainerStarted","Data":"90b6b50d8dcb06dad6553c1c658b989768e70d18e8ad3b6d8dbfa8c28ff595b6"}
Jun 09 02:24:15.845374 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:15.845334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/kube-rbac-proxy/0.log"
Jun 09 02:24:16.044999 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:16.044974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/kube-rbac-proxy-metric/0.log"
Jun 09 02:24:16.244028 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:16.243999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4266ad04-6bae-425f-8a60-ca67f4054ccc/prom-label-proxy/0.log"
Jun 09 02:24:16.814262 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:16.814231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnvkg" event={"ID":"e70df090-e6a8-49c3-a22f-25e688e969a6","Type":"ContainerStarted","Data":"fd9f7ce8d59f9bd9163a96b3d32c7a8922b563d404c967c7ec5ac988e19c4c69"}
Jun 09 02:24:16.814654 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:16.814288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnvkg" event={"ID":"e70df090-e6a8-49c3-a22f-25e688e969a6","Type":"ContainerStarted","Data":"cfb73c1703c4ae701342463d76a6a8d9e86798153123ec33801ba9a04b2c743d"}
Jun 09 02:24:16.830349 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:16.830299    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gnvkg" podStartSLOduration=252.984764775 podStartE2EDuration="4m13.830283968s" totalImagesPullingTime="845.519193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:24:16.828883106 +0000 UTC m=+254.303004759" watchObservedRunningTime="2026-06-09 02:24:16.830283968 +0000 UTC m=+254.304405619"
Jun 09 02:24:17.244362 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:17.244334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d7fcbc986-xpmzs_d0dae03d-2873-4005-838f-ee960f835e16/metrics-server/0.log"
Jun 09 02:24:17.444591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:17.444564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-hw6fs_61f8f75f-a25a-45c2-8004-c68a42f746d6/monitoring-plugin/0.log"
Jun 09 02:24:17.644585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:17.644506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/init-textfile/0.log"
Jun 09 02:24:17.846274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:17.846240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/node-exporter/0.log"
Jun 09 02:24:18.044822 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:18.044795    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/kube-rbac-proxy/0.log"
Jun 09 02:24:19.445133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:19.445100    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/kube-rbac-proxy-main/0.log"
Jun 09 02:24:19.644341 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:19.644310    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/kube-rbac-proxy-self/0.log"
Jun 09 02:24:19.845075 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:19.845050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/openshift-state-metrics/0.log"
Jun 09 02:24:20.045021 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:20.044997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/init-config-reloader/0.log"
Jun 09 02:24:20.246094 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:20.246070    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/prometheus/0.log"
Jun 09 02:24:20.444593 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:20.444560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/config-reloader/0.log"
Jun 09 02:24:20.645415 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:20.645332    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/thanos-sidecar/0.log"
Jun 09 02:24:20.844465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:20.844442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/kube-rbac-proxy-web/0.log"
Jun 09 02:24:21.044765 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:21.044744    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/kube-rbac-proxy/0.log"
Jun 09 02:24:21.244938 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:21.244909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_260d977d-87e5-43b0-baac-aa3b4261ea67/kube-rbac-proxy-thanos/0.log"
Jun 09 02:24:21.844029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:21.843995    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-x9qp7_c78dbdc6-74a9-45b6-bc5a-d73e2ef84826/prometheus-operator-admission-webhook/0.log"
Jun 09 02:24:22.053354 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:22.053321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:24:22.057093 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:22.057070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d7fcbc986-xpmzs"
Jun 09 02:24:22.565618 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:22.565578    2576 patch_prober.go:28] interesting pod/console-8b56b6876-48bwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jun 09 02:24:22.565783 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:22.565628    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jun 09 02:24:24.445351 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:24.445319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5669d8875f-xbhw6_f6f5438f-bd57-4b49-b389-94a3b33c1457/console/0.log"
Jun 09 02:24:24.645226 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:24.645200    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b56b6876-48bwm_1cc59f4d-da86-442b-9c5a-8a9934d9db20/console/0.log"
Jun 09 02:24:26.645405 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:26.645374    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-758bx_26354ed2-3f22-48d7-8f95-3dabdefe0281/dns-node-resolver/0.log"
Jun 09 02:24:26.854041 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:26.854012    2576 generic.go:356] "Generic (PLEG): container finished" podID="b70d6ccb-8c58-4102-96d6-c7877fc49915" containerID="e9c905a72bff119511e02fc917c8272edfb9e8d7d24a0f9cdfc0cd33f598538b" exitCode=0
Jun 09 02:24:26.854146 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:26.854090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q" event={"ID":"b70d6ccb-8c58-4102-96d6-c7877fc49915","Type":"ContainerDied","Data":"e9c905a72bff119511e02fc917c8272edfb9e8d7d24a0f9cdfc0cd33f598538b"}
Jun 09 02:24:26.854409 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:26.854393    2576 scope.go:117] "RemoveContainer" containerID="e9c905a72bff119511e02fc917c8272edfb9e8d7d24a0f9cdfc0cd33f598538b"
Jun 09 02:24:27.644528 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:27.644502    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx8ql_11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3/node-ca/0.log"
Jun 09 02:24:27.860393 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:27.860352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-cfs9q" event={"ID":"b70d6ccb-8c58-4102-96d6-c7877fc49915","Type":"ContainerStarted","Data":"e75f43c310812d0beabd528480ad6b3ec839d144d8b93a7b12466cb2648d0f41"}
Jun 09 02:24:28.245611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:28.245581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:24:28.446069 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:28.446044    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lwmp_933e1b22-dac8-43de-acbd-7848442bbde1/serve-healthcheck-canary/0.log"
Jun 09 02:24:29.506461 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.506438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5669d8875f-xbhw6_f6f5438f-bd57-4b49-b389-94a3b33c1457/console/0.log"
Jun 09 02:24:29.508413 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.508397    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:24:29.594503 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594624    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594777 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594777 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594777 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w476d\" (UniqueName: \"kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.594777 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config\") pod \"f6f5438f-bd57-4b49-b389-94a3b33c1457\" (UID: \"f6f5438f-bd57-4b49-b389-94a3b33c1457\") "
Jun 09 02:24:29.595003 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594790    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:29.595003 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594980    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:29.595003 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.594986    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:29.595154 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.595060    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-oauth-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.595154 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.595078    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.595154 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.595092    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-service-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.595363 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.595336    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config" (OuterVolumeSpecName: "console-config") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:29.597164 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.597140    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:29.597274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.597141    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d" (OuterVolumeSpecName: "kube-api-access-w476d") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "kube-api-access-w476d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:24:29.597274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.597234    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6f5438f-bd57-4b49-b389-94a3b33c1457" (UID: "f6f5438f-bd57-4b49-b389-94a3b33c1457"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:29.696501 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.696408    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.696501 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.696436    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.696501 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.696445    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f5438f-bd57-4b49-b389-94a3b33c1457-console-oauth-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.696501 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.696454    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w476d\" (UniqueName: \"kubernetes.io/projected/f6f5438f-bd57-4b49-b389-94a3b33c1457-kube-api-access-w476d\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:29.869577 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869546    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5669d8875f-xbhw6_f6f5438f-bd57-4b49-b389-94a3b33c1457/console/0.log"
Jun 09 02:24:29.869728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869596    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerID="f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7" exitCode=137
Jun 09 02:24:29.869728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869661    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669d8875f-xbhw6"
Jun 09 02:24:29.869728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669d8875f-xbhw6" event={"ID":"f6f5438f-bd57-4b49-b389-94a3b33c1457","Type":"ContainerDied","Data":"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"}
Jun 09 02:24:29.869840 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669d8875f-xbhw6" event={"ID":"f6f5438f-bd57-4b49-b389-94a3b33c1457","Type":"ContainerDied","Data":"988216f220dc9c7019a6e858aed32e65800c468072c319682f1be4f993c432a8"}
Jun 09 02:24:29.869840 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.869770    2576 scope.go:117] "RemoveContainer" containerID="f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"
Jun 09 02:24:29.878468 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.878451    2576 scope.go:117] "RemoveContainer" containerID="f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"
Jun 09 02:24:29.878707 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:24:29.878689    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7\": container with ID starting with f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7 not found: ID does not exist" containerID="f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"
Jun 09 02:24:29.878773 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.878715    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7"} err="failed to get container status \"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7\": rpc error: code = NotFound desc = could not find container \"f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7\": container with ID starting with f91320ca0a3d236779155f5057dde7f2f700d37269ee83d4129c5a2741197fe7 not found: ID does not exist"
Jun 09 02:24:29.891050 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.891031    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:24:29.893828 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:29.893810    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5669d8875f-xbhw6"]
Jun 09 02:24:30.983396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:30.983365    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" path="/var/lib/kubelet/pods/f6f5438f-bd57-4b49-b389-94a3b33c1457/volumes"
Jun 09 02:24:32.565663 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:32.565621    2576 patch_prober.go:28] interesting pod/console-8b56b6876-48bwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jun 09 02:24:32.566076 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:32.565676    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jun 09 02:24:39.762647 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:39.762607    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:24:43.916142 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:43.916106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:24:43.933177 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:43.933149    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:24:43.948577 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:43.948554    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:24:44.435945 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:24:44.435882    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5gxr" podUID="edd2eab8-cc93-40eb-9564-6d1307ceeb2f"
Jun 09 02:24:44.933311 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:44.933277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:24:47.844082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:47.844041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:24:47.846224 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:47.846197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edd2eab8-cc93-40eb-9564-6d1307ceeb2f-metrics-tls\") pod \"dns-default-b5gxr\" (UID: \"edd2eab8-cc93-40eb-9564-6d1307ceeb2f\") " pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:24:47.936403 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:47.936379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\""
Jun 09 02:24:47.944746 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:47.944727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:24:48.082402 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:48.082348    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5gxr"]
Jun 09 02:24:48.084615 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:24:48.084587    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd2eab8_cc93_40eb_9564_6d1307ceeb2f.slice/crio-d9bf89c62223dd7d658010c6d72bac81c55c7473a8eeed29225c128ff13f8596 WatchSource:0}: Error finding container d9bf89c62223dd7d658010c6d72bac81c55c7473a8eeed29225c128ff13f8596: Status 404 returned error can't find the container with id d9bf89c62223dd7d658010c6d72bac81c55c7473a8eeed29225c128ff13f8596
Jun 09 02:24:48.949266 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:48.949231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5gxr" event={"ID":"edd2eab8-cc93-40eb-9564-6d1307ceeb2f","Type":"ContainerStarted","Data":"d9bf89c62223dd7d658010c6d72bac81c55c7473a8eeed29225c128ff13f8596"}
Jun 09 02:24:49.958163 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:49.958071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5gxr" event={"ID":"edd2eab8-cc93-40eb-9564-6d1307ceeb2f","Type":"ContainerStarted","Data":"f14767f96eac2f38685e00151f339a5cbd3c978eff6b19a405eb91c849f98d2b"}
Jun 09 02:24:49.958511 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:49.958193    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:24:49.958511 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:49.958214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5gxr" event={"ID":"edd2eab8-cc93-40eb-9564-6d1307ceeb2f","Type":"ContainerStarted","Data":"af7669b2ce7cea75884fe6eb505798ef8a1ca05de269e3d8bbd6c6ea8231cecb"}
Jun 09 02:24:49.975843 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:49.975794    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b5gxr" podStartSLOduration=251.578030159 podStartE2EDuration="4m12.975778704s" totalImagesPullingTime="1.397748545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:24:49.973460555 +0000 UTC m=+287.447582206" watchObservedRunningTime="2026-06-09 02:24:49.975778704 +0000 UTC m=+287.449900355"
Jun 09 02:24:57.762767 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.762725    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:24:57.763329 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763071    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="alertmanager" containerID="cri-o://be48336dc01528ff77feaf9a1e3cd7bef54140a35f213963f37003d46c225579" gracePeriod=120
Jun 09 02:24:57.763329 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763116    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-metric" containerID="cri-o://060235b66dfadc9a382c718e2d42282065edd36576346559a3c5c9669cd62c88" gracePeriod=120
Jun 09 02:24:57.763329 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763139    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-web" containerID="cri-o://638f50725e7c1395a248aaf46a4327569dd38b46c0671160aced035a358be362" gracePeriod=120
Jun 09 02:24:57.763329 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763181    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy" containerID="cri-o://a3bfcc1dabf5bb91df782c26fac8a90e86892faec50ec48dbfb28ff7f062d3cc" gracePeriod=120
Jun 09 02:24:57.763329 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763226    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="prom-label-proxy" containerID="cri-o://2800e44e2d87c5b7e6a7ce75793691e2dfb7a8ac98885802e632a7ff5782389b" gracePeriod=120
Jun 09 02:24:57.763599 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.763245    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="config-reloader" containerID="cri-o://ecdd55cacba3ac1513888fa118eaff3c40b2f443cbdbbb6cb60a2cd5f4611134" gracePeriod=120
Jun 09 02:24:57.993579 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993549    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="2800e44e2d87c5b7e6a7ce75793691e2dfb7a8ac98885802e632a7ff5782389b" exitCode=0
Jun 09 02:24:57.993579 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993574    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="a3bfcc1dabf5bb91df782c26fac8a90e86892faec50ec48dbfb28ff7f062d3cc" exitCode=0
Jun 09 02:24:57.993579 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993580    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="ecdd55cacba3ac1513888fa118eaff3c40b2f443cbdbbb6cb60a2cd5f4611134" exitCode=0
Jun 09 02:24:57.993579 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993586    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="be48336dc01528ff77feaf9a1e3cd7bef54140a35f213963f37003d46c225579" exitCode=0
Jun 09 02:24:57.993785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"2800e44e2d87c5b7e6a7ce75793691e2dfb7a8ac98885802e632a7ff5782389b"}
Jun 09 02:24:57.993785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"a3bfcc1dabf5bb91df782c26fac8a90e86892faec50ec48dbfb28ff7f062d3cc"}
Jun 09 02:24:57.993785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"ecdd55cacba3ac1513888fa118eaff3c40b2f443cbdbbb6cb60a2cd5f4611134"}
Jun 09 02:24:57.993785 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:57.993722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"be48336dc01528ff77feaf9a1e3cd7bef54140a35f213963f37003d46c225579"}
Jun 09 02:24:59.000673 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000643    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="060235b66dfadc9a382c718e2d42282065edd36576346559a3c5c9669cd62c88" exitCode=0
Jun 09 02:24:59.000673 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000672    2576 generic.go:356] "Generic (PLEG): container finished" podID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerID="638f50725e7c1395a248aaf46a4327569dd38b46c0671160aced035a358be362" exitCode=0
Jun 09 02:24:59.001029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"060235b66dfadc9a382c718e2d42282065edd36576346559a3c5c9669cd62c88"}
Jun 09 02:24:59.001029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"638f50725e7c1395a248aaf46a4327569dd38b46c0671160aced035a358be362"}
Jun 09 02:24:59.001029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4266ad04-6bae-425f-8a60-ca67f4054ccc","Type":"ContainerDied","Data":"7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00"}
Jun 09 02:24:59.001029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.000833    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e27079d56187b5708c7215162fa3cea9d3deeddf430274db8db1f99c6563a00"
Jun 09 02:24:59.006610 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.006595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:24:59.125838 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.125838 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125840    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.125987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126056    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs59q\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126120    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126344 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") pod \"4266ad04-6bae-425f-8a60-ca67f4054ccc\" (UID: \"4266ad04-6bae-425f-8a60-ca67f4054ccc\") "
Jun 09 02:24:59.126521 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126485    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:59.126814 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.126761    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:24:59.127176 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.127085    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:24:59.128562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.128453    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.128562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.128531    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.128562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.128547    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume" (OuterVolumeSpecName: "config-volume") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.128748 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.128708    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:24:59.128795 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.128778    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.130126 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.130101    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out" (OuterVolumeSpecName: "config-out") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:24:59.130229 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.130158    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q" (OuterVolumeSpecName: "kube-api-access-vs59q") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "kube-api-access-vs59q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:24:59.130335 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.130319    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.133388 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.133297    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.138993 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.138974    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config" (OuterVolumeSpecName: "web-config") pod "4266ad04-6bae-425f-8a60-ca67f4054ccc" (UID: "4266ad04-6bae-425f-8a60-ca67f4054ccc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:24:59.226898 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226878    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-tls-assets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226921    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-cluster-tls-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226937    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226953    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs59q\" (UniqueName: \"kubernetes.io/projected/4266ad04-6bae-425f-8a60-ca67f4054ccc-kube-api-access-vs59q\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226974    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.226987    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4266ad04-6bae-425f-8a60-ca67f4054ccc-metrics-client-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227001 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227000    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-main-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227013    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-out\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227025    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227037    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-config-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227050    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227062    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4266ad04-6bae-425f-8a60-ca67f4054ccc-alertmanager-main-db\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.227216 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.227136    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4266ad04-6bae-425f-8a60-ca67f4054ccc-web-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:24:59.964235 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:24:59.964209    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b5gxr"
Jun 09 02:25:00.005059 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.005032    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.031067 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.031037    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:25:00.037375 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.037351    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:25:00.060224 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060201    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:25:00.060457 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060446    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="alertmanager"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060458    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="alertmanager"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060470    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="init-config-reloader"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060476    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="init-config-reloader"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060484    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-metric"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060489    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-metric"
Jun 09 02:25:00.060496 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060497    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="config-reloader"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060503    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="config-reloader"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060513    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-web"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060518    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-web"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060529    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060533    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060540    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerName="console"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060544    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerName="console"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060549    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="prom-label-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060553    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="prom-label-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060594    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-web"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060601    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="config-reloader"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060608    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy-metric"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060613    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="alertmanager"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060618    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="prom-label-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060625    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" containerName="kube-rbac-proxy"
Jun 09 02:25:00.060655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.060630    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f5438f-bd57-4b49-b389-94a3b33c1457" containerName="console"
Jun 09 02:25:00.065182 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.065167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.067926 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.067881    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 09 02:25:00.068017 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.067879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 09 02:25:00.068017 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.067942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 09 02:25:00.068017 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.067955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5v276\""
Jun 09 02:25:00.068017 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.067971    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 09 02:25:00.068210 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.068195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 09 02:25:00.068255 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.068202    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 09 02:25:00.068301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.068264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 09 02:25:00.068482 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.068466    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 09 02:25:00.072341 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.072321    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 09 02:25:00.082340 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.082322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:25:00.231582 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231668 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231668 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231751 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnttk\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-kube-api-access-cnttk\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.231881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.232030 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.232030 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.231923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332532 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332627 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnttk\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-kube-api-access-cnttk\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.332855 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.332846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.333254 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.333147    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.333536 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.333512    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.333778 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.333752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.335569 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.335545    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.335681 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.335619    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.335811 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.335794    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-out\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.335879 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.335839    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.335979 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.335960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-web-config\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.336206 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.336181    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.336308 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.336260    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.336430 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.336407    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.337637 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.337619    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.341170 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.341148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnttk\" (UniqueName: \"kubernetes.io/projected/0c47b5a3-4959-4834-a6a5-dcd66663f3ea-kube-api-access-cnttk\") pod \"alertmanager-main-0\" (UID: \"0c47b5a3-4959-4834-a6a5-dcd66663f3ea\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.374414 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.374395    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 02:25:00.498658 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.498634    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 02:25:00.500497 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:25:00.500473    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c47b5a3_4959_4834_a6a5_dcd66663f3ea.slice/crio-f4140792f17da68624858c0a99f4c5b29d0c787802c12a46e440815dfe87d85e WatchSource:0}: Error finding container f4140792f17da68624858c0a99f4c5b29d0c787802c12a46e440815dfe87d85e: Status 404 returned error can't find the container with id f4140792f17da68624858c0a99f4c5b29d0c787802c12a46e440815dfe87d85e
Jun 09 02:25:00.983954 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:00.983924    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4266ad04-6bae-425f-8a60-ca67f4054ccc" path="/var/lib/kubelet/pods/4266ad04-6bae-425f-8a60-ca67f4054ccc/volumes"
Jun 09 02:25:01.010718 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.010690    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c47b5a3-4959-4834-a6a5-dcd66663f3ea" containerID="41bb0282d4eb0de269037e50a58e3134f3fbaf8fabc6a1f7b51e18d5a1583273" exitCode=0
Jun 09 02:25:01.011039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.010747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerDied","Data":"41bb0282d4eb0de269037e50a58e3134f3fbaf8fabc6a1f7b51e18d5a1583273"}
Jun 09 02:25:01.011039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.010799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"f4140792f17da68624858c0a99f4c5b29d0c787802c12a46e440815dfe87d85e"}
Jun 09 02:25:01.977462 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977428    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:01.977758 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977713    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="prometheus" containerID="cri-o://32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5" gracePeriod=600
Jun 09 02:25:01.977758 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977741    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="thanos-sidecar" containerID="cri-o://3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38" gracePeriod=600
Jun 09 02:25:01.977972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977765    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="config-reloader" containerID="cri-o://f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a" gracePeriod=600
Jun 09 02:25:01.977972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977807    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6" gracePeriod=600
Jun 09 02:25:01.977972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977810    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-web" containerID="cri-o://aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d" gracePeriod=600
Jun 09 02:25:01.977972 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:01.977741    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy" containerID="cri-o://f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc" gracePeriod=600
Jun 09 02:25:02.019638 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"14603e992ada907e94b42f290237e27595c181c2e670d502d3900ecada61432b"}
Jun 09 02:25:02.019989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"ab8fc6f2a27174e8abdb538c0f13140262514e3db50c88110163ba53202d6fde"}
Jun 09 02:25:02.019989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"2b214aebc5ae780670de97845522cd9a940149f64dc33a9b92f934054e5ead99"}
Jun 09 02:25:02.019989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"cb4cc9587f42026babeec94759ed26143d04756445cf11656eb5a45990891212"}
Jun 09 02:25:02.019989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"bf93e57878c17878d5b6a655ebc18bb9e5f0fae446d13bac37749ce6c2dcc5d5"}
Jun 09 02:25:02.019989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.019770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c47b5a3-4959-4834-a6a5-dcd66663f3ea","Type":"ContainerStarted","Data":"cecf8c2874e6e4c969ddfa547b55e7890b24420017573febc0a1e03c3eb7a2e5"}
Jun 09 02:25:02.043451 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.043406    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.027567297 podStartE2EDuration="2.043393957s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.82666ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:02.041148998 +0000 UTC m=+299.515270662" watchObservedRunningTime="2026-06-09 02:25:02.043393957 +0000 UTC m=+299.517515610"
Jun 09 02:25:02.210655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.210633    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:02.348456 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348395    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348456 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348456 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348695 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348695 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348480    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348695 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348517    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348695 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348633    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56lgn\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348695 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348709    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348846    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.348970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348943    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.349275 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.349275 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348999    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.349275 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349036    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.349275 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349059    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.349275 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy\") pod \"260d977d-87e5-43b0-baac-aa3b4261ea67\" (UID: \"260d977d-87e5-43b0-baac-aa3b4261ea67\") "
Jun 09 02:25:02.351170 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.348740    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349082    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349265    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.349379    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.350263    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.350642    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.351205    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:25:02.351591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.351277    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.351591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.351381    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:02.351940 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.351886    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.352047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.351950    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config" (OuterVolumeSpecName: "config") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.352220 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.352190    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn" (OuterVolumeSpecName: "kube-api-access-56lgn") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "kube-api-access-56lgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:25:02.352319 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.352302    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.352412 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.352394    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.353025 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.352989    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.353112 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.353073    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out" (OuterVolumeSpecName: "config-out") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:25:02.353591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.353569    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:25:02.353871 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.353849    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.354043 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.354024    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.361612 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.361592    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config" (OuterVolumeSpecName: "web-config") pod "260d977d-87e5-43b0-baac-aa3b4261ea67" (UID: "260d977d-87e5-43b0-baac-aa3b4261ea67"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:02.450096 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450070    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-config-out\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450096 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450096    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450110    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56lgn\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-kube-api-access-56lgn\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450122    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450134    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450147    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450160    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-metrics-client-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450174    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450187    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450199    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450213    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-metrics-client-certs\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450226    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/260d977d-87e5-43b0-baac-aa3b4261ea67-tls-assets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450237    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-db\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450250    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450263    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450276    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-kube-rbac-proxy\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450289    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/260d977d-87e5-43b0-baac-aa3b4261ea67-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450300    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-web-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450312    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-secret-grpc-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.450572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.450324    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/260d977d-87e5-43b0-baac-aa3b4261ea67-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:02.931620 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.931595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:25:02.935190 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.935172    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:25:02.937431 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:02.937412    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jun 09 02:25:03.028742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028715    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6" exitCode=0
Jun 09 02:25:03.028742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028735    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc" exitCode=0
Jun 09 02:25:03.028742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028741    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d" exitCode=0
Jun 09 02:25:03.028742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028746    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38" exitCode=0
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028809    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028851    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028754    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a" exitCode=0
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028872    2576 generic.go:356] "Generic (PLEG): container finished" podID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5" exitCode=0
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.028976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"}
Jun 09 02:25:03.029232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.029013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"260d977d-87e5-43b0-baac-aa3b4261ea67","Type":"ContainerDied","Data":"b9d6a3201d8f9ffef86a86c349eaab66fb97ea9b0321b3caff21e460476c8d0a"}
Jun 09 02:25:03.036080 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.036065    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.042500 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.042485    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.048585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.048572    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.054645 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.054630    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.056173 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.056154    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:03.061049 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.061032    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.068784 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.068769    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.072815 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.072784    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:03.075436 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.075419    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.075662 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.075645    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.075736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.075673    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.075736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.075695    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.075922 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.075903    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.075963 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.075927    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.075963 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.075941    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.076154 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.076136    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.076195 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076159    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.076195 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076173    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.076367 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.076352    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.076424 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076373    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.076424 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076390    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.076615 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.076600    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.076650 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076618    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.076650 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076631    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.076815 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.076800    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.076854 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076819    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.076854 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.076831    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.077077 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:03.077063    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.077114 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077079    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.077114 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077090    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.077281 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077266    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.077325 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077282    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.077491 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077471    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.077491 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077490    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.077678 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077662    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.077720 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077679    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.077869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077853    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.077869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.077867    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.078108 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078094    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.078154 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078108    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.078284 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078269    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.078284 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078284    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.078444 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078430    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.078483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078444    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.078604 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078591    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.078644 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078604    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.078777 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.078811 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078777    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.078981 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078958    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.078981 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.078981    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.079170 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079153    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.079207 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079170    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.079337 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079321    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.079392 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079337    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.079553 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079536    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.079605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079554    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.079752 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079739    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.079752 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079751    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.079960 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079944    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.080007 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.079960    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.080149 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080134    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.080189 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080150    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.080358 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080342    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.080358 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080358    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.080530 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080516    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.080569 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080530    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.080712 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080698    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.080760 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080711    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.080914 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080884    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.080954 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.080915    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.081102 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081088    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.081141 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081102    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.081300 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081280    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.081300 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081299    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.081498 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081481    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.081498 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081498    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.081682 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081666    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.081747 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081685    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.081864 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081850    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.081934 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.081864    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.082057 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082040    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.082101 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082057    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.082240 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082224    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.082301 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082241    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.082421 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082407    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.082462 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082421    2576 scope.go:117] "RemoveContainer" containerID="8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"
Jun 09 02:25:03.082566 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082551    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6"} err="failed to get container status \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": rpc error: code = NotFound desc = could not find container \"8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6\": container with ID starting with 8e2465ad1c3709a30fc5a13aef5fc80b8ab81267755108ca524da2832f3f00d6 not found: ID does not exist"
Jun 09 02:25:03.082607 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082566    2576 scope.go:117] "RemoveContainer" containerID="f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"
Jun 09 02:25:03.082719 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082701    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc"} err="failed to get container status \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": rpc error: code = NotFound desc = could not find container \"f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc\": container with ID starting with f530f056f0fafc5a90b2d88ac0e0c3b9846827877c755850aa36ae2c7cabc2cc not found: ID does not exist"
Jun 09 02:25:03.082781 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082720    2576 scope.go:117] "RemoveContainer" containerID="aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"
Jun 09 02:25:03.082941 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082923    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d"} err="failed to get container status \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": rpc error: code = NotFound desc = could not find container \"aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d\": container with ID starting with aded9530c1b0ca7fb9ff449a2f4cdfec7a072ff2e773d0e60d5009abd38dc00d not found: ID does not exist"
Jun 09 02:25:03.082941 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.082939    2576 scope.go:117] "RemoveContainer" containerID="3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"
Jun 09 02:25:03.083114 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083100    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38"} err="failed to get container status \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": rpc error: code = NotFound desc = could not find container \"3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38\": container with ID starting with 3693cfcf9bbe1602a543973e4895205237ecd23be2a62ba50979c5f7bf321e38 not found: ID does not exist"
Jun 09 02:25:03.083114 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083113    2576 scope.go:117] "RemoveContainer" containerID="f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"
Jun 09 02:25:03.083270 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083257    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a"} err="failed to get container status \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": rpc error: code = NotFound desc = could not find container \"f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a\": container with ID starting with f503db15109abf77350b6442563d1cd882c6adc6ff07ae98adda5ab6dcf89b1a not found: ID does not exist"
Jun 09 02:25:03.083307 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083270    2576 scope.go:117] "RemoveContainer" containerID="32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"
Jun 09 02:25:03.083476 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083460    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5"} err="failed to get container status \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": rpc error: code = NotFound desc = could not find container \"32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5\": container with ID starting with 32aeca47aa5ff00415b324f399286f2bedd7aed508bff5953d312620455c99b5 not found: ID does not exist"
Jun 09 02:25:03.083545 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083478    2576 scope.go:117] "RemoveContainer" containerID="d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"
Jun 09 02:25:03.083701 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.083684    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63"} err="failed to get container status \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": rpc error: code = NotFound desc = could not find container \"d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63\": container with ID starting with d5411c63db91e88a21d07d2c41f3e4f59534763d4f3bdc99c30fbed47cf06d63 not found: ID does not exist"
Jun 09 02:25:03.129877 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.129832    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:03.130122 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130110    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-thanos"
Jun 09 02:25:03.130161 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130124    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-thanos"
Jun 09 02:25:03.130161 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130134    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="config-reloader"
Jun 09 02:25:03.130161 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130141    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="config-reloader"
Jun 09 02:25:03.130161 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130154    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-web"
Jun 09 02:25:03.130161 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130159    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-web"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130166    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130171    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130180    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="init-config-reloader"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130184    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="init-config-reloader"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130192    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="thanos-sidecar"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130197    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="thanos-sidecar"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130203    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="prometheus"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130207    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="prometheus"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130260    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-thanos"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130269    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="thanos-sidecar"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130276    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy-web"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130281    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="kube-rbac-proxy"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130287    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="prometheus"
Jun 09 02:25:03.130294 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.130293    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" containerName="config-reloader"
Jun 09 02:25:03.135277 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.135263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.139309 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 09 02:25:03.139309 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 09 02:25:03.139490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139337    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rn7gr\""
Jun 09 02:25:03.139490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 09 02:25:03.139597 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 09 02:25:03.139597 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139588    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 09 02:25:03.139693 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139617    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 09 02:25:03.139823 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 09 02:25:03.139884 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139811    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 09 02:25:03.139884 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139850    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 09 02:25:03.139884 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.139855    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 09 02:25:03.140144 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.140128    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 09 02:25:03.140144 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.140149    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 09 02:25:03.140493 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.140476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7diuo5to974mm\""
Jun 09 02:25:03.145765 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.145745    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 09 02:25:03.146573 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.146556    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 09 02:25:03.152239 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.152221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:03.255682 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8n7\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-kube-api-access-cl8n7\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.255918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.255958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256062 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256234 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256234 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256234 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.256234 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.256170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.356736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.356816 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.356816 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.356816 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.356816 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357153 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357153 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357153 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357153 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.356885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8n7\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-kube-api-access-cl8n7\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357153 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.357979 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.357745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.358265 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.358241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.359827 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.359795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.359940 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.359840    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.360197 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.360152    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.360368 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.360341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361337 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361337 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361485 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361485 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361369    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361485 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361403    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.361951 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.362054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.361965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.362117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.362062    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-config\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.362117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.362093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.362832 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.362807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.362949 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.362843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a94b321-5d87-4119-ba40-4c6bf873ce1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.363352 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.363323    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.364123 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.364099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a94b321-5d87-4119-ba40-4c6bf873ce1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.364482 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.364461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8n7\" (UniqueName: \"kubernetes.io/projected/5a94b321-5d87-4119-ba40-4c6bf873ce1e-kube-api-access-cl8n7\") pod \"prometheus-k8s-0\" (UID: \"5a94b321-5d87-4119-ba40-4c6bf873ce1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.443482 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.443432    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:25:03.571590 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:03.571567    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 09 02:25:03.573511 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:25:03.573482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a94b321_5d87_4119_ba40_4c6bf873ce1e.slice/crio-a72dcf3a5f2125aaa8378f0b04055540cded2322b9c052546dbcc2f2c139dd88 WatchSource:0}: Error finding container a72dcf3a5f2125aaa8378f0b04055540cded2322b9c052546dbcc2f2c139dd88: Status 404 returned error can't find the container with id a72dcf3a5f2125aaa8378f0b04055540cded2322b9c052546dbcc2f2c139dd88
Jun 09 02:25:04.035175 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:04.035141    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a94b321-5d87-4119-ba40-4c6bf873ce1e" containerID="d60c9ce407a89121ac6a47e5d8f14c53bd163dc86a55eda77c7f7ea8838e782e" exitCode=0
Jun 09 02:25:04.035570 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:04.035242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerDied","Data":"d60c9ce407a89121ac6a47e5d8f14c53bd163dc86a55eda77c7f7ea8838e782e"}
Jun 09 02:25:04.035570 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:04.035351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"a72dcf3a5f2125aaa8378f0b04055540cded2322b9c052546dbcc2f2c139dd88"}
Jun 09 02:25:04.782521 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:04.782478    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b56b6876-48bwm" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console" containerID="cri-o://00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3" gracePeriod=15
Jun 09 02:25:04.981642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:04.981607    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="260d977d-87e5-43b0-baac-aa3b4261ea67" path="/var/lib/kubelet/pods/260d977d-87e5-43b0-baac-aa3b4261ea67/volumes"
Jun 09 02:25:05.015844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.015822    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:25:05.044393 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"e60463cdf231e4efc4ca7ee489557c24cad2be5704358f7f305d764e44938402"}
Jun 09 02:25:05.044709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"08aefa51d44a6c499794d96d3d88e48f2f9761efc0efba940fbf0fc15211f43c"}
Jun 09 02:25:05.044709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"1a4de5a5caa3848872571ecefb70f2583e3ccca8546dfcc9cb23774a6ae8f1f8"}
Jun 09 02:25:05.044709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"0f1108204240ffffafd1c7c22792ce551036745ed5e4f3e95935183f8c8b0086"}
Jun 09 02:25:05.044709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"18fc005fd0beb3d8bf3bfa86ac74180c56dd817b05cc0cfdf78b7d3cc8ec4b0e"}
Jun 09 02:25:05.044709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.044554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a94b321-5d87-4119-ba40-4c6bf873ce1e","Type":"ContainerStarted","Data":"c9147379f7c1eb077a29a719dd5bae9f8d7b7d0aca0382a8a109de5a2d7b2201"}
Jun 09 02:25:05.045624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.045597    2576 generic.go:356] "Generic (PLEG): container finished" podID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerID="00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3" exitCode=0
Jun 09 02:25:05.045703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.045634    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b6876-48bwm"
Jun 09 02:25:05.045703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.045655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b6876-48bwm" event={"ID":"1cc59f4d-da86-442b-9c5a-8a9934d9db20","Type":"ContainerDied","Data":"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"}
Jun 09 02:25:05.045703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.045689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b6876-48bwm" event={"ID":"1cc59f4d-da86-442b-9c5a-8a9934d9db20","Type":"ContainerDied","Data":"7bf4d02e1c66a39c79beee9864214b02e717d8955f27ca9f1774861712b05ffd"}
Jun 09 02:25:05.045810 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.045708    2576 scope.go:117] "RemoveContainer" containerID="00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"
Jun 09 02:25:05.053060 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.053043    2576 scope.go:117] "RemoveContainer" containerID="00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"
Jun 09 02:25:05.053305 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:25:05.053286    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3\": container with ID starting with 00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3 not found: ID does not exist" containerID="00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"
Jun 09 02:25:05.053360 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.053314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3"} err="failed to get container status \"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3\": rpc error: code = NotFound desc = could not find container \"00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3\": container with ID starting with 00877ecb62c0bed6e366d25cd255fc9a6a8924e5b8d62c3e5c7261aa3fc647f3 not found: ID does not exist"
Jun 09 02:25:05.069672 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.069627    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.051891145 podStartE2EDuration="2.069611313s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.720168ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:05.068338951 +0000 UTC m=+302.542460603" watchObservedRunningTime="2026-06-09 02:25:05.069611313 +0000 UTC m=+302.543732967"
Jun 09 02:25:05.171131 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171109    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nbpl\" (UniqueName: \"kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171223 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171223 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171223 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171210    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171327 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171327 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171277    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.171429 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171404    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert\") pod \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\" (UID: \"1cc59f4d-da86-442b-9c5a-8a9934d9db20\") "
Jun 09 02:25:05.172490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171571    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config" (OuterVolumeSpecName: "console-config") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:05.172490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171611    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca" (OuterVolumeSpecName: "service-ca") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:05.172490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171650    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:05.172490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.171854    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:25:05.172706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.172525    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.172706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.172545    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-oauth-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.172706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.172559    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.172706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.172572    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc59f4d-da86-442b-9c5a-8a9934d9db20-service-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.173651 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.173618    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:05.173788 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.173763    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl" (OuterVolumeSpecName: "kube-api-access-5nbpl") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "kube-api-access-5nbpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:25:05.174074 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.174054    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1cc59f4d-da86-442b-9c5a-8a9934d9db20" (UID: "1cc59f4d-da86-442b-9c5a-8a9934d9db20"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:25:05.273517 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.273491    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-oauth-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.273517 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.273515    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1cc59f4d-da86-442b-9c5a-8a9934d9db20-console-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.273648 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.273529    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nbpl\" (UniqueName: \"kubernetes.io/projected/1cc59f4d-da86-442b-9c5a-8a9934d9db20-kube-api-access-5nbpl\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:25:05.366139 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.366113    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:25:05.374172 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:05.374149    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b56b6876-48bwm"]
Jun 09 02:25:06.981769 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:06.981725    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" path="/var/lib/kubelet/pods/1cc59f4d-da86-442b-9c5a-8a9934d9db20/volumes"
Jun 09 02:25:08.444002 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:25:08.443967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:26:03.444389 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:03.444356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:26:03.460257 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:03.460232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:26:04.300107 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:04.300082    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 09 02:26:32.947713 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.947674    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"]
Jun 09 02:26:32.948274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.948055    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console"
Jun 09 02:26:32.948274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.948069    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console"
Jun 09 02:26:32.948274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.948127    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc59f4d-da86-442b-9c5a-8a9934d9db20" containerName="console"
Jun 09 02:26:32.951707 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.951688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:32.954222 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.954193    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 09 02:26:32.954337 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.954316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hxjj6\""
Jun 09 02:26:32.955465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.955446    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 09 02:26:32.960353 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:32.960259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"]
Jun 09 02:26:33.098484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.098460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418bc801-c164-462d-9de5-e581ec6aba0d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.098605 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.098514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqttf\" (UniqueName: \"kubernetes.io/projected/418bc801-c164-462d-9de5-e581ec6aba0d-kube-api-access-qqttf\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.199824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.199759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418bc801-c164-462d-9de5-e581ec6aba0d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.199824 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.199805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqttf\" (UniqueName: \"kubernetes.io/projected/418bc801-c164-462d-9de5-e581ec6aba0d-kube-api-access-qqttf\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.200130 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.200108    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418bc801-c164-462d-9de5-e581ec6aba0d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.207805 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.207781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqttf\" (UniqueName: \"kubernetes.io/projected/418bc801-c164-462d-9de5-e581ec6aba0d-kube-api-access-qqttf\") pod \"openshift-lws-operator-fd8ccff4c-pmww8\" (UID: \"418bc801-c164-462d-9de5-e581ec6aba0d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.277805 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.277785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"
Jun 09 02:26:33.401145 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.401119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8"]
Jun 09 02:26:33.403374 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:26:33.403340    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod418bc801_c164_462d_9de5_e581ec6aba0d.slice/crio-4939080430bc5361c1a5c1afeba8f44a4447fed01c67f7cfeb7ac7bfbf3e93c3 WatchSource:0}: Error finding container 4939080430bc5361c1a5c1afeba8f44a4447fed01c67f7cfeb7ac7bfbf3e93c3: Status 404 returned error can't find the container with id 4939080430bc5361c1a5c1afeba8f44a4447fed01c67f7cfeb7ac7bfbf3e93c3
Jun 09 02:26:33.404926 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:33.404886    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 02:26:34.411822 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:34.411776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8" event={"ID":"418bc801-c164-462d-9de5-e581ec6aba0d","Type":"ContainerStarted","Data":"4939080430bc5361c1a5c1afeba8f44a4447fed01c67f7cfeb7ac7bfbf3e93c3"}
Jun 09 02:26:36.422844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:36.422773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8" event={"ID":"418bc801-c164-462d-9de5-e581ec6aba0d","Type":"ContainerStarted","Data":"d21daef4103a059fa1356e0f423940f83717e4e1c522b8bc10d05afe157b0010"}
Jun 09 02:26:36.438421 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:36.438380    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pmww8" podStartSLOduration=1.788067775 podStartE2EDuration="4.43836577s" totalImagesPullingTime="2.650297995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:36.437476887 +0000 UTC m=+393.911598538" watchObservedRunningTime="2026-06-09 02:26:36.43836577 +0000 UTC m=+393.912487421"
Jun 09 02:26:55.304825 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.304792    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"]
Jun 09 02:26:55.312995 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.312972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.316841 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.316820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzlcg\""
Jun 09 02:26:55.316983 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.316962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 09 02:26:55.317199 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.317183    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 09 02:26:55.317297 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.317278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 09 02:26:55.317529 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.317507    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 09 02:26:55.327414 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.327390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"]
Jun 09 02:26:55.354368 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.354344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.354453 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.354389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pbc\" (UniqueName: \"kubernetes.io/projected/59d53a29-dd55-461a-9cdd-ea42c510944e-kube-api-access-c5pbc\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.354453 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.354415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.354523 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.354464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.354523 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.354500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.454952 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.454931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.455050 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.454968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pbc\" (UniqueName: \"kubernetes.io/projected/59d53a29-dd55-461a-9cdd-ea42c510944e-kube-api-access-c5pbc\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.455050 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.454988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.455182 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.455135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.455237 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.455223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.455534 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.455515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.457203 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.457177    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59d53a29-dd55-461a-9cdd-ea42c510944e-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.457533 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.457508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.457601 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.457536    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/59d53a29-dd55-461a-9cdd-ea42c510944e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.463397 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.463372    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pbc\" (UniqueName: \"kubernetes.io/projected/59d53a29-dd55-461a-9cdd-ea42c510944e-kube-api-access-c5pbc\") pod \"opendatahub-operator-controller-manager-777db45658-4j6xl\" (UID: \"59d53a29-dd55-461a-9cdd-ea42c510944e\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.623353 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.623293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:26:55.753391 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:55.753364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"]
Jun 09 02:26:55.755489 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:26:55.755456    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d53a29_dd55_461a_9cdd_ea42c510944e.slice/crio-7ce65f689f5510cd41f4df6e8ae8291122d59d4b72c399c4db7a58e014b0e42f WatchSource:0}: Error finding container 7ce65f689f5510cd41f4df6e8ae8291122d59d4b72c399c4db7a58e014b0e42f: Status 404 returned error can't find the container with id 7ce65f689f5510cd41f4df6e8ae8291122d59d4b72c399c4db7a58e014b0e42f
Jun 09 02:26:56.513319 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:56.513284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl" event={"ID":"59d53a29-dd55-461a-9cdd-ea42c510944e","Type":"ContainerStarted","Data":"7ce65f689f5510cd41f4df6e8ae8291122d59d4b72c399c4db7a58e014b0e42f"}
Jun 09 02:26:58.523201 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:58.523174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl" event={"ID":"59d53a29-dd55-461a-9cdd-ea42c510944e","Type":"ContainerStarted","Data":"e34964eb3649fff20da4ca049214caadbfe9ecb1248a5a1cc0a9168d8c4ebf69"}
Jun 09 02:26:59.528772 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:59.528740    2576 generic.go:356] "Generic (PLEG): container finished" podID="59d53a29-dd55-461a-9cdd-ea42c510944e" containerID="e34964eb3649fff20da4ca049214caadbfe9ecb1248a5a1cc0a9168d8c4ebf69" exitCode=0
Jun 09 02:26:59.529075 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:26:59.528826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl" event={"ID":"59d53a29-dd55-461a-9cdd-ea42c510944e","Type":"ContainerDied","Data":"e34964eb3649fff20da4ca049214caadbfe9ecb1248a5a1cc0a9168d8c4ebf69"}
Jun 09 02:27:00.535999 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:00.535962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl" event={"ID":"59d53a29-dd55-461a-9cdd-ea42c510944e","Type":"ContainerStarted","Data":"9583b9670cf6673a5b06931a3021fb116159d76094c3bdc86fbaae6e1159f82e"}
Jun 09 02:27:00.536449 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:00.536045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:27:00.556320 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:00.556273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl" podStartSLOduration=1.664744798 podStartE2EDuration="5.556260583s" totalImagesPullingTime="2.929079171s" totalInitContainerRuntime="962.436614ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:00.554578724 +0000 UTC m=+418.028700376" watchObservedRunningTime="2026-06-09 02:27:00.556260583 +0000 UTC m=+418.030382233"
Jun 09 02:27:11.542638 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:11.542600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-4j6xl"
Jun 09 02:27:14.114711 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.114675    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"]
Jun 09 02:27:14.122906 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.122879    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.125460 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.125435    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vgnt2\""
Jun 09 02:27:14.125460 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.125454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 09 02:27:14.125592 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.125445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 09 02:27:14.128864 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.128844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"]
Jun 09 02:27:14.193671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.193641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882eb9bd-1a52-44ab-beb8-f1920a61206d-tmp\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.193671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.193671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.193856 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.193698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78dx5\" (UniqueName: \"kubernetes.io/projected/882eb9bd-1a52-44ab-beb8-f1920a61206d-kube-api-access-78dx5\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.294658 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.294633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dx5\" (UniqueName: \"kubernetes.io/projected/882eb9bd-1a52-44ab-beb8-f1920a61206d-kube-api-access-78dx5\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.294833 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.294738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882eb9bd-1a52-44ab-beb8-f1920a61206d-tmp\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.294833 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.294778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.294967 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:27:14.294885    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jun 09 02:27:14.295033 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:27:14.294978    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs podName:882eb9bd-1a52-44ab-beb8-f1920a61206d nodeName:}" failed. No retries permitted until 2026-06-09 02:27:14.794957598 +0000 UTC m=+432.269079229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs") pod "kube-auth-proxy-5687f7b7-bwfs4" (UID: "882eb9bd-1a52-44ab-beb8-f1920a61206d") : secret "kube-auth-proxy-tls" not found
Jun 09 02:27:14.296846 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.296822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882eb9bd-1a52-44ab-beb8-f1920a61206d-tmp\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.305041 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.305021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78dx5\" (UniqueName: \"kubernetes.io/projected/882eb9bd-1a52-44ab-beb8-f1920a61206d-kube-api-access-78dx5\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.352696 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.352677    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zzl4l"]
Jun 09 02:27:14.356088 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.356072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.358659 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.358637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 09 02:27:14.358804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.358672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6ptb4\""
Jun 09 02:27:14.365133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.365091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zzl4l"]
Jun 09 02:27:14.395716 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.395690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5601209e-4526-4f91-aa52-fa2b82eb897b-cert\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.395826 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.395773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sh5v\" (UniqueName: \"kubernetes.io/projected/5601209e-4526-4f91-aa52-fa2b82eb897b-kube-api-access-7sh5v\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.496258 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.496231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5601209e-4526-4f91-aa52-fa2b82eb897b-cert\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.496373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.496334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh5v\" (UniqueName: \"kubernetes.io/projected/5601209e-4526-4f91-aa52-fa2b82eb897b-kube-api-access-7sh5v\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.498511 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.498490    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5601209e-4526-4f91-aa52-fa2b82eb897b-cert\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.505665 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.505640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sh5v\" (UniqueName: \"kubernetes.io/projected/5601209e-4526-4f91-aa52-fa2b82eb897b-kube-api-access-7sh5v\") pod \"odh-model-controller-6dc94f689f-zzl4l\" (UID: \"5601209e-4526-4f91-aa52-fa2b82eb897b\") " pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.666353 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.666255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:14.731576 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.729931    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lp5xt"]
Jun 09 02:27:14.735022 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.734938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.739037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.738942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 09 02:27:14.739394 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.739377    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-t9kg7\""
Jun 09 02:27:14.742663 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.742627    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lp5xt"]
Jun 09 02:27:14.798687 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.798660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.798826 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.798711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6f4186-1248-4f08-986c-c39e6ee02046-tls-certs\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.798826 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.798744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6d9\" (UniqueName: \"kubernetes.io/projected/da6f4186-1248-4f08-986c-c39e6ee02046-kube-api-access-rn6d9\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.800770 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.800752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882eb9bd-1a52-44ab-beb8-f1920a61206d-tls-certs\") pod \"kube-auth-proxy-5687f7b7-bwfs4\" (UID: \"882eb9bd-1a52-44ab-beb8-f1920a61206d\") " pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:14.813408 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.813391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zzl4l"]
Jun 09 02:27:14.815389 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:14.815369    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5601209e_4526_4f91_aa52_fa2b82eb897b.slice/crio-6fbeb82ef345458380c9e30eb5bdc045786ac42a12348838e0bf721910d1a638 WatchSource:0}: Error finding container 6fbeb82ef345458380c9e30eb5bdc045786ac42a12348838e0bf721910d1a638: Status 404 returned error can't find the container with id 6fbeb82ef345458380c9e30eb5bdc045786ac42a12348838e0bf721910d1a638
Jun 09 02:27:14.900032 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.900006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6d9\" (UniqueName: \"kubernetes.io/projected/da6f4186-1248-4f08-986c-c39e6ee02046-kube-api-access-rn6d9\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.900160 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.900093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6f4186-1248-4f08-986c-c39e6ee02046-tls-certs\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.902283 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.902262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6f4186-1248-4f08-986c-c39e6ee02046-tls-certs\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:14.907881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:14.907861    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6d9\" (UniqueName: \"kubernetes.io/projected/da6f4186-1248-4f08-986c-c39e6ee02046-kube-api-access-rn6d9\") pod \"model-serving-api-5dd488fc48-lp5xt\" (UID: \"da6f4186-1248-4f08-986c-c39e6ee02046\") " pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:15.034147 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.034123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"
Jun 09 02:27:15.050268 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.050241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:15.176015 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.175877    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4"]
Jun 09 02:27:15.178524 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:15.178495    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882eb9bd_1a52_44ab_beb8_f1920a61206d.slice/crio-04460c726c91070df2ffd6c7d01442c9b7c721384dfa121e2e2d5d35fc27003c WatchSource:0}: Error finding container 04460c726c91070df2ffd6c7d01442c9b7c721384dfa121e2e2d5d35fc27003c: Status 404 returned error can't find the container with id 04460c726c91070df2ffd6c7d01442c9b7c721384dfa121e2e2d5d35fc27003c
Jun 09 02:27:15.195535 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.195514    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lp5xt"]
Jun 09 02:27:15.197122 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:15.197100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6f4186_1248_4f08_986c_c39e6ee02046.slice/crio-a164b3946e02a1cca92b6bfd3ddb12e91e7ec093ee3005b5a08de133424f2fd5 WatchSource:0}: Error finding container a164b3946e02a1cca92b6bfd3ddb12e91e7ec093ee3005b5a08de133424f2fd5: Status 404 returned error can't find the container with id a164b3946e02a1cca92b6bfd3ddb12e91e7ec093ee3005b5a08de133424f2fd5
Jun 09 02:27:15.608913 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.608858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt" event={"ID":"da6f4186-1248-4f08-986c-c39e6ee02046","Type":"ContainerStarted","Data":"a164b3946e02a1cca92b6bfd3ddb12e91e7ec093ee3005b5a08de133424f2fd5"}
Jun 09 02:27:15.610251 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.610219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4" event={"ID":"882eb9bd-1a52-44ab-beb8-f1920a61206d","Type":"ContainerStarted","Data":"04460c726c91070df2ffd6c7d01442c9b7c721384dfa121e2e2d5d35fc27003c"}
Jun 09 02:27:15.611416 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:15.611390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l" event={"ID":"5601209e-4526-4f91-aa52-fa2b82eb897b","Type":"ContainerStarted","Data":"6fbeb82ef345458380c9e30eb5bdc045786ac42a12348838e0bf721910d1a638"}
Jun 09 02:27:20.644549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.644503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4" event={"ID":"882eb9bd-1a52-44ab-beb8-f1920a61206d","Type":"ContainerStarted","Data":"ae0b291aee3ce6acf392b7d54ba18b2a02bfe7c7a974ba776f8418280503d27f"}
Jun 09 02:27:20.646382 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.646352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l" event={"ID":"5601209e-4526-4f91-aa52-fa2b82eb897b","Type":"ContainerStarted","Data":"097d582181106555645502f173a2f72a636f2fe40b0fdc7a9d7df07bfeab0f27"}
Jun 09 02:27:20.646513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.646451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:20.647957 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.647936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt" event={"ID":"da6f4186-1248-4f08-986c-c39e6ee02046","Type":"ContainerStarted","Data":"e78fedb4ea50a1e99789de48144dd7ce28d0199d2ef6de19d89866ed6cd0805c"}
Jun 09 02:27:20.648056 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.647998    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:20.662913 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.662864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5687f7b7-bwfs4" podStartSLOduration=2.055398731 podStartE2EDuration="6.662852449s" totalImagesPullingTime="4.607453718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:20.661288164 +0000 UTC m=+438.135409815" watchObservedRunningTime="2026-06-09 02:27:20.662852449 +0000 UTC m=+438.136974102"
Jun 09 02:27:20.677213 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.677171    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l" podStartSLOduration=1.7654226629999998 podStartE2EDuration="6.677155863s" totalImagesPullingTime="4.9117332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:20.676639102 +0000 UTC m=+438.150760755" watchObservedRunningTime="2026-06-09 02:27:20.677155863 +0000 UTC m=+438.151277516"
Jun 09 02:27:20.696240 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:20.696206    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt" podStartSLOduration=2.177580294 podStartE2EDuration="6.696195186s" totalImagesPullingTime="4.518614892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:20.69525513 +0000 UTC m=+438.169376784" watchObservedRunningTime="2026-06-09 02:27:20.696195186 +0000 UTC m=+438.170316837"
Jun 09 02:27:24.571989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.571960    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dfqk5"]
Jun 09 02:27:24.575450 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.575424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.578436 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.578417    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 09 02:27:24.578545 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.578418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8zpsc\""
Jun 09 02:27:24.585427 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.585404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dfqk5"]
Jun 09 02:27:24.589041 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.589014    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"]
Jun 09 02:27:24.592518 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.592501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.595193 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.595173    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 09 02:27:24.595349 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.595333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ck8xk\""
Jun 09 02:27:24.604582 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.604561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"]
Jun 09 02:27:24.681242 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.681219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-cert\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.681342 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.681248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.681342 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.681279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8968x\" (UniqueName: \"kubernetes.io/projected/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-kube-api-access-8968x\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.681424 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.681374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndfvg\" (UniqueName: \"kubernetes.io/projected/38c09b4a-3a54-4d89-9158-ff294ff4a62c-kube-api-access-ndfvg\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.782030 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.782006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8968x\" (UniqueName: \"kubernetes.io/projected/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-kube-api-access-8968x\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.782126 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.782041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndfvg\" (UniqueName: \"kubernetes.io/projected/38c09b4a-3a54-4d89-9158-ff294ff4a62c-kube-api-access-ndfvg\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.782126 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.782075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-cert\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.782126 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.782107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.782230 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:27:24.782196    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jun 09 02:27:24.782272 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:27:24.782244    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert podName:38c09b4a-3a54-4d89-9158-ff294ff4a62c nodeName:}" failed. No retries permitted until 2026-06-09 02:27:25.28222704 +0000 UTC m=+442.756348671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert") pod "llmisvc-controller-manager-864bfd7bc9-8vf26" (UID: "38c09b4a-3a54-4d89-9158-ff294ff4a62c") : secret "llmisvc-webhook-server-cert" not found
Jun 09 02:27:24.784371 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.784351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-cert\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.792746 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.792726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndfvg\" (UniqueName: \"kubernetes.io/projected/38c09b4a-3a54-4d89-9158-ff294ff4a62c-kube-api-access-ndfvg\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:24.793173 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.793157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8968x\" (UniqueName: \"kubernetes.io/projected/aced19c1-ae78-4f7b-b466-dfa1e13ed0a8-kube-api-access-8968x\") pod \"kserve-controller-manager-69fc866d76-dfqk5\" (UID: \"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:24.885730 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:24.885683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:25.005905 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.005872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dfqk5"]
Jun 09 02:27:25.007860 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:25.007832    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaced19c1_ae78_4f7b_b466_dfa1e13ed0a8.slice/crio-caad3424e9b14572b20a492be824d12659bc004192529386eadb5af323950432 WatchSource:0}: Error finding container caad3424e9b14572b20a492be824d12659bc004192529386eadb5af323950432: Status 404 returned error can't find the container with id caad3424e9b14572b20a492be824d12659bc004192529386eadb5af323950432
Jun 09 02:27:25.286113 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.286083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:25.288306 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.288284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38c09b4a-3a54-4d89-9158-ff294ff4a62c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8vf26\" (UID: \"38c09b4a-3a54-4d89-9158-ff294ff4a62c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:25.501700 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.501669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:25.622694 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.622673    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"]
Jun 09 02:27:25.625026 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:25.625002    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38c09b4a_3a54_4d89_9158_ff294ff4a62c.slice/crio-27b2f77f6c97119615e92264ec343f1a44cf9aec064b7ecd6e6e56059ca4c686 WatchSource:0}: Error finding container 27b2f77f6c97119615e92264ec343f1a44cf9aec064b7ecd6e6e56059ca4c686: Status 404 returned error can't find the container with id 27b2f77f6c97119615e92264ec343f1a44cf9aec064b7ecd6e6e56059ca4c686
Jun 09 02:27:25.672040 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.672016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5" event={"ID":"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8","Type":"ContainerStarted","Data":"caad3424e9b14572b20a492be824d12659bc004192529386eadb5af323950432"}
Jun 09 02:27:25.673059 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:25.673037    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26" event={"ID":"38c09b4a-3a54-4d89-9158-ff294ff4a62c","Type":"ContainerStarted","Data":"27b2f77f6c97119615e92264ec343f1a44cf9aec064b7ecd6e6e56059ca4c686"}
Jun 09 02:27:28.689300 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.689259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5" event={"ID":"aced19c1-ae78-4f7b-b466-dfa1e13ed0a8","Type":"ContainerStarted","Data":"51c46f21cd036e7a8255ba80e1b4f143d3e1a4d0bbfcdc6c934199245a7ae8d2"}
Jun 09 02:27:28.689656 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.689331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:27:28.690760 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.690734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26" event={"ID":"38c09b4a-3a54-4d89-9158-ff294ff4a62c","Type":"ContainerStarted","Data":"f222082a9c98bddaaec9fd46f40afe74e8a9dfaa8ee9b8bca69ec7d9cd3c1dda"}
Jun 09 02:27:28.690884 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.690864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:28.720191 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.720146    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5" podStartSLOduration=1.924602385 podStartE2EDuration="4.720133167s" totalImagesPullingTime="2.795530782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:28.718622722 +0000 UTC m=+446.192744375" watchObservedRunningTime="2026-06-09 02:27:28.720133167 +0000 UTC m=+446.194254818"
Jun 09 02:27:28.749800 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:28.749763    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26" podStartSLOduration=1.898922113 podStartE2EDuration="4.749750061s" totalImagesPullingTime="2.850827948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:28.74879641 +0000 UTC m=+446.222918059" watchObservedRunningTime="2026-06-09 02:27:28.749750061 +0000 UTC m=+446.223871712"
Jun 09 02:27:30.587797 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.587761    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jg4g5"]
Jun 09 02:27:30.591271 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.591252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.594432 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.594409    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 09 02:27:30.594535 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.594472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rrnb5\""
Jun 09 02:27:30.602423 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.602403    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jg4g5"]
Jun 09 02:27:30.731830 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.731803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zwp\" (UniqueName: \"kubernetes.io/projected/28656746-c6a1-4f12-84c9-c15373665d0f-kube-api-access-87zwp\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.731830 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.731839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/28656746-c6a1-4f12-84c9-c15373665d0f-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.833071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.833042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zwp\" (UniqueName: \"kubernetes.io/projected/28656746-c6a1-4f12-84c9-c15373665d0f-kube-api-access-87zwp\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.833178 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.833076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/28656746-c6a1-4f12-84c9-c15373665d0f-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.833683 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.833661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/28656746-c6a1-4f12-84c9-c15373665d0f-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.846106 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.846051    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"]
Jun 09 02:27:30.849399 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.849381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:30.850611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.850588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zwp\" (UniqueName: \"kubernetes.io/projected/28656746-c6a1-4f12-84c9-c15373665d0f-kube-api-access-87zwp\") pod \"dashboard-redirect-865f6f7c76-jg4g5\" (UID: \"28656746-c6a1-4f12-84c9-c15373665d0f\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.851984 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.851964    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-mhh2q\""
Jun 09 02:27:30.852073 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.851968    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 09 02:27:30.852129 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.852114    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 09 02:27:30.865288 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.865265    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"]
Jun 09 02:27:30.902232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.902211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5"
Jun 09 02:27:30.934172 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.934140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:30.934269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:30.934207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksfnx\" (UniqueName: \"kubernetes.io/projected/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-kube-api-access-ksfnx\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.035471 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.035438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.035628 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.035494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksfnx\" (UniqueName: \"kubernetes.io/projected/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-kube-api-access-ksfnx\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.038302 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.038267    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.049190 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.049164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksfnx\" (UniqueName: \"kubernetes.io/projected/fb088be3-5d3a-4ed6-98f6-eba4a5f0829c-kube-api-access-ksfnx\") pod \"servicemesh-operator3-57f65f65fb-x96nt\" (UID: \"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.052318 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.052233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jg4g5"]
Jun 09 02:27:31.054793 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:31.054767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28656746_c6a1_4f12_84c9_c15373665d0f.slice/crio-ebbdfce77a98d24a653643bf304eda04b17fb03caa95338f6ca4f827a3f00169 WatchSource:0}: Error finding container ebbdfce77a98d24a653643bf304eda04b17fb03caa95338f6ca4f827a3f00169: Status 404 returned error can't find the container with id ebbdfce77a98d24a653643bf304eda04b17fb03caa95338f6ca4f827a3f00169
Jun 09 02:27:31.165787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.165737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:31.298209 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.298185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"]
Jun 09 02:27:31.301031 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:31.301003    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb088be3_5d3a_4ed6_98f6_eba4a5f0829c.slice/crio-18410500baa24a8e58391865cc2441397240fc70aec1147c60e1e76fd9972b29 WatchSource:0}: Error finding container 18410500baa24a8e58391865cc2441397240fc70aec1147c60e1e76fd9972b29: Status 404 returned error can't find the container with id 18410500baa24a8e58391865cc2441397240fc70aec1147c60e1e76fd9972b29
Jun 09 02:27:31.654449 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.654425    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zzl4l"
Jun 09 02:27:31.656704 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.656685    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-lp5xt"
Jun 09 02:27:31.707766 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.707733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5" event={"ID":"28656746-c6a1-4f12-84c9-c15373665d0f","Type":"ContainerStarted","Data":"ebbdfce77a98d24a653643bf304eda04b17fb03caa95338f6ca4f827a3f00169"}
Jun 09 02:27:31.709590 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:31.709562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt" event={"ID":"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c","Type":"ContainerStarted","Data":"18410500baa24a8e58391865cc2441397240fc70aec1147c60e1e76fd9972b29"}
Jun 09 02:27:34.727686 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:34.727602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5" event={"ID":"28656746-c6a1-4f12-84c9-c15373665d0f","Type":"ContainerStarted","Data":"2516c882a0d1df714f8d15ab514e5757a0df01b6b710c80b725fd101eb153cc6"}
Jun 09 02:27:34.729907 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:34.729860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt" event={"ID":"fb088be3-5d3a-4ed6-98f6-eba4a5f0829c","Type":"ContainerStarted","Data":"578607bc13545c75484d5fb8123450f65165b5bf77cf71d67c2f62324f0160f7"}
Jun 09 02:27:34.730428 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:34.730401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:34.743941 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:34.743874    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-865f6f7c76-jg4g5" podStartSLOduration=1.232938524 podStartE2EDuration="4.74385441s" totalImagesPullingTime="3.510915886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:34.743388183 +0000 UTC m=+452.217509835" watchObservedRunningTime="2026-06-09 02:27:34.74385441 +0000 UTC m=+452.217976061"
Jun 09 02:27:34.770050 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:34.769994    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt" podStartSLOduration=1.499871613 podStartE2EDuration="4.769975542s" totalImagesPullingTime="3.270103929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:34.769276314 +0000 UTC m=+452.243397965" watchObservedRunningTime="2026-06-09 02:27:34.769975542 +0000 UTC m=+452.244097194"
Jun 09 02:27:41.083473 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.083439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"]
Jun 09 02:27:41.089550 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.089529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.094171 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.094151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 09 02:27:41.094872 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.094502    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 09 02:27:41.095138 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.094623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vwzvn\""
Jun 09 02:27:41.095372 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.094672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 09 02:27:41.095953 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.094712    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 09 02:27:41.101858 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.101808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"]
Jun 09 02:27:41.220434 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220580 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220619 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220669 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfxb\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-kube-api-access-8sfxb\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220765 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.220798 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.220783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.321964 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.321930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.321977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfxb\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-kube-api-access-8sfxb\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322328 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322328 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.322571 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.322526    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.324930 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.324876    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.325177 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.325157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.325279 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.325222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.328931 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.325622    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.331510 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.331478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.331644 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.331625    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfxb\" (UniqueName: \"kubernetes.io/projected/1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3-kube-api-access-8sfxb\") pod \"istiod-openshift-gateway-75c67f8887-f5z2s\" (UID: \"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.412084 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.412020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:41.546297 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.546273    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"]
Jun 09 02:27:41.548625 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:27:41.548600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0415df_6e5b_4f5f_80be_7c7c66f8b5a3.slice/crio-db62fdf84c2de615886b884d19aa1f936fb5a3d5fad645ba1597efb2c44cabb9 WatchSource:0}: Error finding container db62fdf84c2de615886b884d19aa1f936fb5a3d5fad645ba1597efb2c44cabb9: Status 404 returned error can't find the container with id db62fdf84c2de615886b884d19aa1f936fb5a3d5fad645ba1597efb2c44cabb9
Jun 09 02:27:41.765636 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:41.765599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s" event={"ID":"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3","Type":"ContainerStarted","Data":"db62fdf84c2de615886b884d19aa1f936fb5a3d5fad645ba1597efb2c44cabb9"}
Jun 09 02:27:43.717729 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:43.717691    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:27:43.717996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:43.717757    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:27:43.782187 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:43.782162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s" event={"ID":"1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3","Type":"ContainerStarted","Data":"66727c37b4f56e217b062978d18a7e93536058ec26b19672dfaec7c1d993be66"}
Jun 09 02:27:43.782334 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:43.782319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:43.799925 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:43.799806    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s" podStartSLOduration=0.63278138 podStartE2EDuration="2.799789116s" totalImagesPullingTime="2.167007736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:43.799764908 +0000 UTC m=+461.273886583" watchObservedRunningTime="2026-06-09 02:27:43.799789116 +0000 UTC m=+461.273910767"
Jun 09 02:27:44.796401 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:44.796366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f5z2s"
Jun 09 02:27:46.742835 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:46.742801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x96nt"
Jun 09 02:27:59.697859 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:59.697823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8vf26"
Jun 09 02:27:59.700913 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:27:59.700869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dfqk5"
Jun 09 02:28:51.820789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.820699    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"]
Jun 09 02:28:51.824230 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.824208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:51.826957 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.826932    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 09 02:28:51.827097 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.827075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 09 02:28:51.828200 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.828183    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5kkhz\""
Jun 09 02:28:51.834353 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.834327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"]
Jun 09 02:28:51.953374 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:51.953343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp5t4\" (UniqueName: \"kubernetes.io/projected/c9d1f1bf-45ec-4bde-947a-d47ae9a8e204-kube-api-access-tp5t4\") pod \"authorino-operator-75cc8d5cb7-9j8gb\" (UID: \"c9d1f1bf-45ec-4bde-947a-d47ae9a8e204\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:52.053936 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:52.053911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp5t4\" (UniqueName: \"kubernetes.io/projected/c9d1f1bf-45ec-4bde-947a-d47ae9a8e204-kube-api-access-tp5t4\") pod \"authorino-operator-75cc8d5cb7-9j8gb\" (UID: \"c9d1f1bf-45ec-4bde-947a-d47ae9a8e204\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:52.072468 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:52.072416    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp5t4\" (UniqueName: \"kubernetes.io/projected/c9d1f1bf-45ec-4bde-947a-d47ae9a8e204-kube-api-access-tp5t4\") pod \"authorino-operator-75cc8d5cb7-9j8gb\" (UID: \"c9d1f1bf-45ec-4bde-947a-d47ae9a8e204\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:52.136071 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:52.136052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:52.258578 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:52.258555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"]
Jun 09 02:28:52.260604 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:28:52.260578    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d1f1bf_45ec_4bde_947a_d47ae9a8e204.slice/crio-93fad1fdc843cc5a030fea897f695c9b1bdeceff6c0f2b0e38179bca8253dd04 WatchSource:0}: Error finding container 93fad1fdc843cc5a030fea897f695c9b1bdeceff6c0f2b0e38179bca8253dd04: Status 404 returned error can't find the container with id 93fad1fdc843cc5a030fea897f695c9b1bdeceff6c0f2b0e38179bca8253dd04
Jun 09 02:28:53.133252 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:53.133222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb" event={"ID":"c9d1f1bf-45ec-4bde-947a-d47ae9a8e204","Type":"ContainerStarted","Data":"93fad1fdc843cc5a030fea897f695c9b1bdeceff6c0f2b0e38179bca8253dd04"}
Jun 09 02:28:55.143675 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:55.143639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb" event={"ID":"c9d1f1bf-45ec-4bde-947a-d47ae9a8e204","Type":"ContainerStarted","Data":"b0782a23c5c94350e326c42eff50ce62f05833188ee310d24ba30c9cb95894fd"}
Jun 09 02:28:55.144022 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:55.143766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:28:55.170037 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:55.169997    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb" podStartSLOduration=1.948113535 podStartE2EDuration="4.169984926s" totalImagesPullingTime="2.221871391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:55.168603986 +0000 UTC m=+532.642725639" watchObservedRunningTime="2026-06-09 02:28:55.169984926 +0000 UTC m=+532.644106577"
Jun 09 02:28:59.672542 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.672511    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"]
Jun 09 02:28:59.676222 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.676201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.678709 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.678687    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn6hf\""
Jun 09 02:28:59.688718 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.688695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"]
Jun 09 02:28:59.814396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.814371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.814497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.814409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8f7f\" (UniqueName: \"kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.915505 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.915476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.915611 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.915511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8f7f\" (UniqueName: \"kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.915853 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.915830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.924416 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.924357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8f7f\" (UniqueName: \"kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:28:59.986401 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:28:59.986377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:00.116924 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:00.116879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"]
Jun 09 02:29:00.120910 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:29:00.120869    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b176cc_d35e_435d_aa7d_ac909cdef5be.slice/crio-448bd1c164339890e03ded438d72f11c342ecf4df62d5b719a48272398eeb4f7 WatchSource:0}: Error finding container 448bd1c164339890e03ded438d72f11c342ecf4df62d5b719a48272398eeb4f7: Status 404 returned error can't find the container with id 448bd1c164339890e03ded438d72f11c342ecf4df62d5b719a48272398eeb4f7
Jun 09 02:29:00.172345 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:00.172316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j" event={"ID":"57b176cc-d35e-435d-aa7d-ac909cdef5be","Type":"ContainerStarted","Data":"448bd1c164339890e03ded438d72f11c342ecf4df62d5b719a48272398eeb4f7"}
Jun 09 02:29:06.151937 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:06.151877    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9j8gb"
Jun 09 02:29:07.209948 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:07.209918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j" event={"ID":"57b176cc-d35e-435d-aa7d-ac909cdef5be","Type":"ContainerStarted","Data":"37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f"}
Jun 09 02:29:07.210423 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:07.210028    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:07.229961 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:07.229922    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j" podStartSLOduration=1.276123733 podStartE2EDuration="8.229880952s" totalImagesPullingTime="6.953757219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:07.228328343 +0000 UTC m=+544.702450034" watchObservedRunningTime="2026-06-09 02:29:07.229880952 +0000 UTC m=+544.704002604"
Jun 09 02:29:18.217218 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:18.217190    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:19.824257 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.824217    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"]
Jun 09 02:29:19.824706 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.824393    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" containerName="manager" containerID="cri-o://37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f" gracePeriod=2
Jun 09 02:29:19.829981 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.829952    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"]
Jun 09 02:29:19.846483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.846439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:19.846844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.846831    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" containerName="manager"
Jun 09 02:29:19.846907 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.846844    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" containerName="manager"
Jun 09 02:29:19.846947 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.846929    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" containerName="manager"
Jun 09 02:29:19.851008 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.850975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:19.853533 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:19.853504    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:19.864924 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.864883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:19.969665 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.969634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:19.969791 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:19.969683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzp6\" (UniqueName: \"kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.059637 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.059617    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:20.062052 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:20.062023    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:20.070501 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.070477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.070609 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.070537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzp6\" (UniqueName: \"kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.070863 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.070844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.090151 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.090103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzp6\" (UniqueName: \"kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7rgj\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.171152 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.171128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8f7f\" (UniqueName: \"kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f\") pod \"57b176cc-d35e-435d-aa7d-ac909cdef5be\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") "
Jun 09 02:29:20.171252 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.171188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume\") pod \"57b176cc-d35e-435d-aa7d-ac909cdef5be\" (UID: \"57b176cc-d35e-435d-aa7d-ac909cdef5be\") "
Jun 09 02:29:20.171634 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.171614    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57b176cc-d35e-435d-aa7d-ac909cdef5be" (UID: "57b176cc-d35e-435d-aa7d-ac909cdef5be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:29:20.173067 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.173047    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f" (OuterVolumeSpecName: "kube-api-access-k8f7f") pod "57b176cc-d35e-435d-aa7d-ac909cdef5be" (UID: "57b176cc-d35e-435d-aa7d-ac909cdef5be"). InnerVolumeSpecName "kube-api-access-k8f7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:29:20.201883 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.201861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:20.272273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.272245    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8f7f\" (UniqueName: \"kubernetes.io/projected/57b176cc-d35e-435d-aa7d-ac909cdef5be-kube-api-access-k8f7f\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:29:20.272273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.272271    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b176cc-d35e-435d-aa7d-ac909cdef5be-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:29:20.285717 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.285629    2576 generic.go:356] "Generic (PLEG): container finished" podID="57b176cc-d35e-435d-aa7d-ac909cdef5be" containerID="37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f" exitCode=0
Jun 09 02:29:20.285717 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.285691    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:20.285924 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.285773    2576 scope.go:117] "RemoveContainer" containerID="37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f"
Jun 09 02:29:20.289209 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:20.289179    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:20.297217 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.296818    2576 scope.go:117] "RemoveContainer" containerID="37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f"
Jun 09 02:29:20.297321 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:20.297233    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f\": container with ID starting with 37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f not found: ID does not exist" containerID="37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f"
Jun 09 02:29:20.297321 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.297261    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f"} err="failed to get container status \"37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f\": rpc error: code = NotFound desc = could not find container \"37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f\": container with ID starting with 37db9b8370c544292cd0e0a8f9b1d76044e2f6628928a76e2777fbff6881306f not found: ID does not exist"
Jun 09 02:29:20.298600 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:20.298570    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl59j\" is forbidden: User \"system:node:ip-10-0-128-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-73.ec2.internal' and this object" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl59j"
Jun 09 02:29:20.345368 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:29:20.345346    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846860f9_73d0_4c32_9d88_9af624ec47ba.slice/crio-9d6b3b71894220c70dcc85d9b1f82e0b22e62fa51b1aa3b198c666481a95d333 WatchSource:0}: Error finding container 9d6b3b71894220c70dcc85d9b1f82e0b22e62fa51b1aa3b198c666481a95d333: Status 404 returned error can't find the container with id 9d6b3b71894220c70dcc85d9b1f82e0b22e62fa51b1aa3b198c666481a95d333
Jun 09 02:29:20.348946 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.348928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:20.981728 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:20.981697    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b176cc-d35e-435d-aa7d-ac909cdef5be" path="/var/lib/kubelet/pods/57b176cc-d35e-435d-aa7d-ac909cdef5be/volumes"
Jun 09 02:29:21.293484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:21.293392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" event={"ID":"846860f9-73d0-4c32-9d88-9af624ec47ba","Type":"ContainerStarted","Data":"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"}
Jun 09 02:29:21.293484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:21.293459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:21.293484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:21.293484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" event={"ID":"846860f9-73d0-4c32-9d88-9af624ec47ba","Type":"ContainerStarted","Data":"9d6b3b71894220c70dcc85d9b1f82e0b22e62fa51b1aa3b198c666481a95d333"}
Jun 09 02:29:21.316638 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:21.316596    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" podStartSLOduration=2.316581654 podStartE2EDuration="2.316581654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:21.314277678 +0000 UTC m=+558.788399325" watchObservedRunningTime="2026-06-09 02:29:21.316581654 +0000 UTC m=+558.790703305"
Jun 09 02:29:32.302236 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:32.302203    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:47.145102 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.145070    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:47.145512 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.145255    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" podUID="846860f9-73d0-4c32-9d88-9af624ec47ba" containerName="manager" containerID="cri-o://261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8" gracePeriod=10
Jun 09 02:29:47.394594 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.394567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:47.433804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.433716    2576 generic.go:356] "Generic (PLEG): container finished" podID="846860f9-73d0-4c32-9d88-9af624ec47ba" containerID="261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8" exitCode=0
Jun 09 02:29:47.433804 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.433782    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"
Jun 09 02:29:47.434054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.433806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" event={"ID":"846860f9-73d0-4c32-9d88-9af624ec47ba","Type":"ContainerDied","Data":"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"}
Jun 09 02:29:47.434054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.433858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj" event={"ID":"846860f9-73d0-4c32-9d88-9af624ec47ba","Type":"ContainerDied","Data":"9d6b3b71894220c70dcc85d9b1f82e0b22e62fa51b1aa3b198c666481a95d333"}
Jun 09 02:29:47.434054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.433887    2576 scope.go:117] "RemoveContainer" containerID="261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"
Jun 09 02:29:47.444123 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.444108    2576 scope.go:117] "RemoveContainer" containerID="261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"
Jun 09 02:29:47.444366 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:29:47.444345    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8\": container with ID starting with 261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8 not found: ID does not exist" containerID="261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"
Jun 09 02:29:47.444427 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.444374    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8"} err="failed to get container status \"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8\": rpc error: code = NotFound desc = could not find container \"261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8\": container with ID starting with 261376075e1cdbb25c8a6419125a7414c3dcf801cc5736dc0c54883cbc6b20d8 not found: ID does not exist"
Jun 09 02:29:47.484912 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.484874    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume\") pod \"846860f9-73d0-4c32-9d88-9af624ec47ba\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") "
Jun 09 02:29:47.485022 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.484988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpzp6\" (UniqueName: \"kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6\") pod \"846860f9-73d0-4c32-9d88-9af624ec47ba\" (UID: \"846860f9-73d0-4c32-9d88-9af624ec47ba\") "
Jun 09 02:29:47.485209 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.485192    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "846860f9-73d0-4c32-9d88-9af624ec47ba" (UID: "846860f9-73d0-4c32-9d88-9af624ec47ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 02:29:47.485278 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.485261    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846860f9-73d0-4c32-9d88-9af624ec47ba-extensions-socket-volume\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:29:47.486809 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.486791    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6" (OuterVolumeSpecName: "kube-api-access-zpzp6") pod "846860f9-73d0-4c32-9d88-9af624ec47ba" (UID: "846860f9-73d0-4c32-9d88-9af624ec47ba"). InnerVolumeSpecName "kube-api-access-zpzp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:29:47.586346 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.586324    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpzp6\" (UniqueName: \"kubernetes.io/projected/846860f9-73d0-4c32-9d88-9af624ec47ba-kube-api-access-zpzp6\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:29:47.755793 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.755769    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:47.759232 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:47.759203    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7rgj"]
Jun 09 02:29:48.982198 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:29:48.982166    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846860f9-73d0-4c32-9d88-9af624ec47ba" path="/var/lib/kubelet/pods/846860f9-73d0-4c32-9d88-9af624ec47ba/volumes"
Jun 09 02:30:02.968249 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.968214    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:30:02.968786 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.968764    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:30:02.975970 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.975945    2576 scope.go:117] "RemoveContainer" containerID="2800e44e2d87c5b7e6a7ce75793691e2dfb7a8ac98885802e632a7ff5782389b"
Jun 09 02:30:02.983946 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.983927    2576 scope.go:117] "RemoveContainer" containerID="060235b66dfadc9a382c718e2d42282065edd36576346559a3c5c9669cd62c88"
Jun 09 02:30:03.004018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.991097    2576 scope.go:117] "RemoveContainer" containerID="a3bfcc1dabf5bb91df782c26fac8a90e86892faec50ec48dbfb28ff7f062d3cc"
Jun 09 02:30:03.004018 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:02.998048    2576 scope.go:117] "RemoveContainer" containerID="ecdd55cacba3ac1513888fa118eaff3c40b2f443cbdbbb6cb60a2cd5f4611134"
Jun 09 02:30:03.005497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.005476    2576 scope.go:117] "RemoveContainer" containerID="2b64034bb27ba8a438e0dc3af2e347018507a246195e10d4e8243ba54be42519"
Jun 09 02:30:03.012395 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.012377    2576 scope.go:117] "RemoveContainer" containerID="638f50725e7c1395a248aaf46a4327569dd38b46c0671160aced035a358be362"
Jun 09 02:30:03.018758 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.018737    2576 scope.go:117] "RemoveContainer" containerID="be48336dc01528ff77feaf9a1e3cd7bef54140a35f213963f37003d46c225579"
Jun 09 02:30:03.406832 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.406803    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"]
Jun 09 02:30:03.407767 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.407681    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846860f9-73d0-4c32-9d88-9af624ec47ba" containerName="manager"
Jun 09 02:30:03.407767 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.407711    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="846860f9-73d0-4c32-9d88-9af624ec47ba" containerName="manager"
Jun 09 02:30:03.408004 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.407812    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="846860f9-73d0-4c32-9d88-9af624ec47ba" containerName="manager"
Jun 09 02:30:03.412871 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.412849    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.415540 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.415522    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h9dsq\""
Jun 09 02:30:03.421341 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.421319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"]
Jun 09 02:30:03.513837 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.513803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.513996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.513853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.513996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.513918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.513996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.513951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.514165 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.514003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/492ad355-1eb6-4bb1-b141-bb095feae1aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.514165 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.514069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcj6\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-kube-api-access-ptcj6\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.514165 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.514107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.514332 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.514195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.514332 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.514216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.615698 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.615874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.615874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/492ad355-1eb6-4bb1-b141-bb095feae1aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.615874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcj6\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-kube-api-access-ptcj6\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.615874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616124 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616124 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.615973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616124 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616124 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616367 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616277    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616461 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/492ad355-1eb6-4bb1-b141-bb095feae1aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616664 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616657    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.616735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.616679    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.618192 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.618169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.618366 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.618350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.623435 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.623410    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.623620 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.623600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcj6\" (UniqueName: \"kubernetes.io/projected/492ad355-1eb6-4bb1-b141-bb095feae1aa-kube-api-access-ptcj6\") pod \"maas-default-gateway-openshift-default-687ff6996-g75fn\" (UID: \"492ad355-1eb6-4bb1-b141-bb095feae1aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.726606 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.726582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:03.855863 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:03.855836    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"]
Jun 09 02:30:03.857969 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:30:03.857941    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492ad355_1eb6_4bb1_b141_bb095feae1aa.slice/crio-2da30493ae545ae6a89b442c25cfbaba26d4d0f1fda6ba1dedeb7b489650e56c WatchSource:0}: Error finding container 2da30493ae545ae6a89b442c25cfbaba26d4d0f1fda6ba1dedeb7b489650e56c: Status 404 returned error can't find the container with id 2da30493ae545ae6a89b442c25cfbaba26d4d0f1fda6ba1dedeb7b489650e56c
Jun 09 02:30:04.527363 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:04.527326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" event={"ID":"492ad355-1eb6-4bb1-b141-bb095feae1aa","Type":"ContainerStarted","Data":"2da30493ae545ae6a89b442c25cfbaba26d4d0f1fda6ba1dedeb7b489650e56c"}
Jun 09 02:30:08.426290 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.426255    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:30:08.426517 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.426324    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:30:08.426517 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.426350    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:30:08.550603 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.550550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" event={"ID":"492ad355-1eb6-4bb1-b141-bb095feae1aa","Type":"ContainerStarted","Data":"23160d9363854fba88cdbe3e5d74bf45d2ad5ee2e5097d05463b5b347b622f89"}
Jun 09 02:30:08.570282 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.570238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" podStartSLOduration=1.004441398 podStartE2EDuration="5.570221972s" totalImagesPullingTime="4.565780574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:08.568528662 +0000 UTC m=+606.042650350" watchObservedRunningTime="2026-06-09 02:30:08.570221972 +0000 UTC m=+606.044343623"
Jun 09 02:30:08.727445 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.727416    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:08.965450 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.965417    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:08.969559 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.969542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:08.972085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.972060    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 09 02:30:08.972231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.972123    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nq6h5\""
Jun 09 02:30:08.975473 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:08.975447    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:09.059187 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.059110    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:09.062538 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.062511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.062654 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.062608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5s7\" (UniqueName: \"kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.163591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.163558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.163741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.163638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5s7\" (UniqueName: \"kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.164624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.164601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.172217 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.172197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5s7\" (UniqueName: \"kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7\") pod \"limitador-limitador-64c94fd64f-xk62p\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.282019 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.282000    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:09.405736 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.405712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:09.407461 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:30:09.407437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ba800b_e98c_46e5_8bcf_fd28015ee81b.slice/crio-714532a402cededb08d54d8600d6aa5c0193bcd2e0b46049b2ec4bd99239e17b WatchSource:0}: Error finding container 714532a402cededb08d54d8600d6aa5c0193bcd2e0b46049b2ec4bd99239e17b: Status 404 returned error can't find the container with id 714532a402cededb08d54d8600d6aa5c0193bcd2e0b46049b2ec4bd99239e17b
Jun 09 02:30:09.555552 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.555527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" event={"ID":"d6ba800b-e98c-46e5-8bcf-fd28015ee81b","Type":"ContainerStarted","Data":"714532a402cededb08d54d8600d6aa5c0193bcd2e0b46049b2ec4bd99239e17b"}
Jun 09 02:30:09.731342 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:09.731320    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:10.563347 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:10.563318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:10.564465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:10.564437    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:30:12.582050 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:12.582011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" event={"ID":"d6ba800b-e98c-46e5-8bcf-fd28015ee81b","Type":"ContainerStarted","Data":"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"}
Jun 09 02:30:12.582467 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:12.582089    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:12.596960 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:12.596888    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" podStartSLOduration=2.030401718 podStartE2EDuration="4.596873682s" totalImagesPullingTime="2.566471964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:12.596211557 +0000 UTC m=+610.070333209" watchObservedRunningTime="2026-06-09 02:30:12.596873682 +0000 UTC m=+610.070995333"
Jun 09 02:30:23.588789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:23.588697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:25.861027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:25.860992    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:25.861430 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:25.861175    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" podUID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" containerName="limitador" containerID="cri-o://cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9" gracePeriod=30
Jun 09 02:30:26.396394 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.396373    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:26.500940 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.500917    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv5s7\" (UniqueName: \"kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7\") pod \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") "
Jun 09 02:30:26.501039 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.500960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file\") pod \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\" (UID: \"d6ba800b-e98c-46e5-8bcf-fd28015ee81b\") "
Jun 09 02:30:26.501323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.501299    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file" (OuterVolumeSpecName: "config-file") pod "d6ba800b-e98c-46e5-8bcf-fd28015ee81b" (UID: "d6ba800b-e98c-46e5-8bcf-fd28015ee81b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 02:30:26.502776 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.502747    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7" (OuterVolumeSpecName: "kube-api-access-bv5s7") pod "d6ba800b-e98c-46e5-8bcf-fd28015ee81b" (UID: "d6ba800b-e98c-46e5-8bcf-fd28015ee81b"). InnerVolumeSpecName "kube-api-access-bv5s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:30:26.601886 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.601862    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv5s7\" (UniqueName: \"kubernetes.io/projected/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-kube-api-access-bv5s7\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:30:26.601999 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.601932    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6ba800b-e98c-46e5-8bcf-fd28015ee81b-config-file\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:30:26.651672 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.651641    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" containerID="cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9" exitCode=0
Jun 09 02:30:26.651743 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.651682    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p"
Jun 09 02:30:26.651743 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.651688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" event={"ID":"d6ba800b-e98c-46e5-8bcf-fd28015ee81b","Type":"ContainerDied","Data":"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"}
Jun 09 02:30:26.651743 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.651739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xk62p" event={"ID":"d6ba800b-e98c-46e5-8bcf-fd28015ee81b","Type":"ContainerDied","Data":"714532a402cededb08d54d8600d6aa5c0193bcd2e0b46049b2ec4bd99239e17b"}
Jun 09 02:30:26.651844 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.651763    2576 scope.go:117] "RemoveContainer" containerID="cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"
Jun 09 02:30:26.660118 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.660100    2576 scope.go:117] "RemoveContainer" containerID="cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"
Jun 09 02:30:26.660347 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:30:26.660329    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9\": container with ID starting with cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9 not found: ID does not exist" containerID="cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"
Jun 09 02:30:26.660397 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.660355    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9"} err="failed to get container status \"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9\": rpc error: code = NotFound desc = could not find container \"cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9\": container with ID starting with cdfdaac5afefad26cd6907d80a7388c69e6ee033d8863c425f11d4a37ba955c9 not found: ID does not exist"
Jun 09 02:30:26.673756 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.673736    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:26.677288 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.677270    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xk62p"]
Jun 09 02:30:26.982390 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:26.982355    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" path="/var/lib/kubelet/pods/d6ba800b-e98c-46e5-8bcf-fd28015ee81b/volumes"
Jun 09 02:30:30.582688 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.582647    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"]
Jun 09 02:30:30.583351 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.583327    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" containerName="limitador"
Jun 09 02:30:30.583351 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.583350    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" containerName="limitador"
Jun 09 02:30:30.583474 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.583425    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ba800b-e98c-46e5-8bcf-fd28015ee81b" containerName="limitador"
Jun 09 02:30:30.588256 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.588229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.591565 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.591116    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jun 09 02:30:30.591565 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.591146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\""
Jun 09 02:30:30.591565 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.591417    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jun 09 02:30:30.592624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.592600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-w5cht\""
Jun 09 02:30:30.593562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.593538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"]
Jun 09 02:30:30.731177 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.731143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e76cbd4-5012-435a-9208-03d3c24c6c67-data\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.731330 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.731199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5fg\" (UniqueName: \"kubernetes.io/projected/3e76cbd4-5012-435a-9208-03d3c24c6c67-kube-api-access-qr5fg\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.831853 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.831823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e76cbd4-5012-435a-9208-03d3c24c6c67-data\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.832008 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.831873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5fg\" (UniqueName: \"kubernetes.io/projected/3e76cbd4-5012-435a-9208-03d3c24c6c67-kube-api-access-qr5fg\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.832227 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.832207    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e76cbd4-5012-435a-9208-03d3c24c6c67-data\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.841608 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.841552    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5fg\" (UniqueName: \"kubernetes.io/projected/3e76cbd4-5012-435a-9208-03d3c24c6c67-kube-api-access-qr5fg\") pod \"postgres-69fb4594cf-hprg2\" (UID: \"3e76cbd4-5012-435a-9208-03d3c24c6c67\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:30.902073 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:30.902053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:31.024789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:31.024765    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"]
Jun 09 02:30:31.026447 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:30:31.026424    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e76cbd4_5012_435a_9208_03d3c24c6c67.slice/crio-907a7b2a06fa5965a84dbe39a77dce025d14a5b173768dd3fc9a5ce0e9d344ff WatchSource:0}: Error finding container 907a7b2a06fa5965a84dbe39a77dce025d14a5b173768dd3fc9a5ce0e9d344ff: Status 404 returned error can't find the container with id 907a7b2a06fa5965a84dbe39a77dce025d14a5b173768dd3fc9a5ce0e9d344ff
Jun 09 02:30:31.681576 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:31.681546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2" event={"ID":"3e76cbd4-5012-435a-9208-03d3c24c6c67","Type":"ContainerStarted","Data":"907a7b2a06fa5965a84dbe39a77dce025d14a5b173768dd3fc9a5ce0e9d344ff"}
Jun 09 02:30:34.698403 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:34.698324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2" event={"ID":"3e76cbd4-5012-435a-9208-03d3c24c6c67","Type":"ContainerStarted","Data":"3f6950b7f3e6c21e32e8c7f1094482fd1176dcb3661112603861c93091687785"}
Jun 09 02:30:34.698811 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:34.698453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:30:34.712787 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:34.712744    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2" podStartSLOduration=1.459750321 podStartE2EDuration="4.712732004s" totalImagesPullingTime="3.252981683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:34.711778239 +0000 UTC m=+632.185899890" watchObservedRunningTime="2026-06-09 02:30:34.712732004 +0000 UTC m=+632.186853654"
Jun 09 02:30:40.738926 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:30:40.738880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-hprg2"
Jun 09 02:31:43.743872 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.743837    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:31:43.747655 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.747640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.750099 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.750070    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jun 09 02:31:43.750220 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.750100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 09 02:31:43.750220 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.750101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mrlr7\""
Jun 09 02:31:43.759432 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.759406    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:31:43.799557 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.799524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.799761 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.799675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69tb2\" (UniqueName: \"kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.900445 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.900408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69tb2\" (UniqueName: \"kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.900635 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.900505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.900635 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:31:43.900615    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jun 09 02:31:43.900756 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:31:43.900688    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert podName:abe22612-6e1a-4e1d-ab56-9df39427ca8e nodeName:}" failed. No retries permitted until 2026-06-09 02:31:44.400666206 +0000 UTC m=+701.874787839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert") pod "maas-controller-77bfcbf864-vzmhl" (UID: "abe22612-6e1a-4e1d-ab56-9df39427ca8e") : secret "maas-controller-webhook-cert" not found
Jun 09 02:31:43.910979 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.910954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69tb2\" (UniqueName: \"kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:43.914944 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.914920    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:31:43.918668 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.918646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:43.928586 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:43.928553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:31:44.001671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.001581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.001671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.001615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2mj\" (UniqueName: \"kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.102803 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.102758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.102803 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.102801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2mj\" (UniqueName: \"kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.105102 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.105082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.110542 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.110518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2mj\" (UniqueName: \"kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj\") pod \"maas-controller-85c84bb9b5-wtkk9\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") " pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.230187 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.230153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:44.404286 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.404211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:44.406457 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.406428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") pod \"maas-controller-77bfcbf864-vzmhl\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") " pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:44.568027 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.568002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:31:44.569961 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:31:44.569930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc133daee_3be5_490f_8a98_39c649350cd2.slice/crio-e2a05457d1393be6b91da902f24ab2780d69af341ce43c86b5832c67210548f8 WatchSource:0}: Error finding container e2a05457d1393be6b91da902f24ab2780d69af341ce43c86b5832c67210548f8: Status 404 returned error can't find the container with id e2a05457d1393be6b91da902f24ab2780d69af341ce43c86b5832c67210548f8
Jun 09 02:31:44.571413 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.571395    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 02:31:44.657607 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.657574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:44.787540 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:44.787514    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:31:44.788855 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:31:44.788828    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe22612_6e1a_4e1d_ab56_9df39427ca8e.slice/crio-59c6c70b6d69374886818a620c0192ecfa4e674ee30eb51c1635f38fd4435f4c WatchSource:0}: Error finding container 59c6c70b6d69374886818a620c0192ecfa4e674ee30eb51c1635f38fd4435f4c: Status 404 returned error can't find the container with id 59c6c70b6d69374886818a620c0192ecfa4e674ee30eb51c1635f38fd4435f4c
Jun 09 02:31:45.040446 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:45.040413    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" event={"ID":"abe22612-6e1a-4e1d-ab56-9df39427ca8e","Type":"ContainerStarted","Data":"59c6c70b6d69374886818a620c0192ecfa4e674ee30eb51c1635f38fd4435f4c"}
Jun 09 02:31:45.041447 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:45.041420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" event={"ID":"c133daee-3be5-490f-8a98-39c649350cd2","Type":"ContainerStarted","Data":"e2a05457d1393be6b91da902f24ab2780d69af341ce43c86b5832c67210548f8"}
Jun 09 02:31:48.063168 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.063132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" event={"ID":"abe22612-6e1a-4e1d-ab56-9df39427ca8e","Type":"ContainerStarted","Data":"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"}
Jun 09 02:31:48.063594 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.063284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:48.064743 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.064721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" event={"ID":"c133daee-3be5-490f-8a98-39c649350cd2","Type":"ContainerStarted","Data":"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"}
Jun 09 02:31:48.064883 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.064770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:48.079049 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.079005    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" podStartSLOduration=2.665208117 podStartE2EDuration="5.078992804s" totalImagesPullingTime="2.413784687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:48.078349945 +0000 UTC m=+705.552471600" watchObservedRunningTime="2026-06-09 02:31:48.078992804 +0000 UTC m=+705.553114457"
Jun 09 02:31:48.094055 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:48.094015    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" podStartSLOduration=2.454688128 podStartE2EDuration="5.094002984s" totalImagesPullingTime="2.639314856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:48.093230901 +0000 UTC m=+705.567352555" watchObservedRunningTime="2026-06-09 02:31:48.094002984 +0000 UTC m=+705.568124673"
Jun 09 02:31:59.073842 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.073814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:59.074206 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.073874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:31:59.125913 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.125868    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:31:59.126540 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.126156    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" podUID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" containerName="manager" containerID="cri-o://2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9" gracePeriod=30
Jun 09 02:31:59.368607 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.368583    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:31:59.437599 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.437570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69tb2\" (UniqueName: \"kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2\") pod \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") "
Jun 09 02:31:59.437765 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.437660    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") pod \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\" (UID: \"abe22612-6e1a-4e1d-ab56-9df39427ca8e\") "
Jun 09 02:31:59.439749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.439714    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2" (OuterVolumeSpecName: "kube-api-access-69tb2") pod "abe22612-6e1a-4e1d-ab56-9df39427ca8e" (UID: "abe22612-6e1a-4e1d-ab56-9df39427ca8e"). InnerVolumeSpecName "kube-api-access-69tb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:31:59.439749 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.439740    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "abe22612-6e1a-4e1d-ab56-9df39427ca8e" (UID: "abe22612-6e1a-4e1d-ab56-9df39427ca8e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:31:59.539152 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.539118    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69tb2\" (UniqueName: \"kubernetes.io/projected/abe22612-6e1a-4e1d-ab56-9df39427ca8e-kube-api-access-69tb2\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:31:59.539152 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:31:59.539147    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abe22612-6e1a-4e1d-ab56-9df39427ca8e-webhook-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:32:00.124289 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.124254    2576 generic.go:356] "Generic (PLEG): container finished" podID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" containerID="2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9" exitCode=0
Jun 09 02:32:00.124671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.124301    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bfcbf864-vzmhl"
Jun 09 02:32:00.124671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.124338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" event={"ID":"abe22612-6e1a-4e1d-ab56-9df39427ca8e","Type":"ContainerDied","Data":"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"}
Jun 09 02:32:00.124671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.124392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bfcbf864-vzmhl" event={"ID":"abe22612-6e1a-4e1d-ab56-9df39427ca8e","Type":"ContainerDied","Data":"59c6c70b6d69374886818a620c0192ecfa4e674ee30eb51c1635f38fd4435f4c"}
Jun 09 02:32:00.124671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.124420    2576 scope.go:117] "RemoveContainer" containerID="2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"
Jun 09 02:32:00.133671 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.133526    2576 scope.go:117] "RemoveContainer" containerID="2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"
Jun 09 02:32:00.133804 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:32:00.133768    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9\": container with ID starting with 2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9 not found: ID does not exist" containerID="2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"
Jun 09 02:32:00.133847 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.133813    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9"} err="failed to get container status \"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9\": rpc error: code = NotFound desc = could not find container \"2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9\": container with ID starting with 2f5b12cf662813d13ef31bb7549c0817528695708a237b177897941d061553a9 not found: ID does not exist"
Jun 09 02:32:00.144564 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.144542    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:32:00.148192 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.148170    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77bfcbf864-vzmhl"]
Jun 09 02:32:00.982377 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:00.982345    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" path="/var/lib/kubelet/pods/abe22612-6e1a-4e1d-ab56-9df39427ca8e/volumes"
Jun 09 02:32:16.389342 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.389306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-6555d96656-df94d"]
Jun 09 02:32:16.389801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.389696    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" containerName="manager"
Jun 09 02:32:16.389801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.389707    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" containerName="manager"
Jun 09 02:32:16.389801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.389779    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe22612-6e1a-4e1d-ab56-9df39427ca8e" containerName="manager"
Jun 09 02:32:16.394170 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.394154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.398205 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.398182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-xd8sj\""
Jun 09 02:32:16.398305 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.398215    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jun 09 02:32:16.404530 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.404504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6555d96656-df94d"]
Jun 09 02:32:16.486996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.486970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-maas-api-tls\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.486996 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.486999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x56qr\" (UniqueName: \"kubernetes.io/projected/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-kube-api-access-x56qr\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.588040 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.588011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-maas-api-tls\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.588040 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.588047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x56qr\" (UniqueName: \"kubernetes.io/projected/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-kube-api-access-x56qr\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.590831 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.590806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-maas-api-tls\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.595594 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.595565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x56qr\" (UniqueName: \"kubernetes.io/projected/211ca0a9-6b1d-49de-8f5e-bb1b4eae2032-kube-api-access-x56qr\") pod \"maas-api-6555d96656-df94d\" (UID: \"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032\") " pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.705860 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.705783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:16.839252 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:16.839227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6555d96656-df94d"]
Jun 09 02:32:16.841595 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:32:16.841566    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211ca0a9_6b1d_49de_8f5e_bb1b4eae2032.slice/crio-ab839b34959fcf6b8a0e1ea2ceea9beffd6aef27d9b7b900d1196f256db89f4f WatchSource:0}: Error finding container ab839b34959fcf6b8a0e1ea2ceea9beffd6aef27d9b7b900d1196f256db89f4f: Status 404 returned error can't find the container with id ab839b34959fcf6b8a0e1ea2ceea9beffd6aef27d9b7b900d1196f256db89f4f
Jun 09 02:32:17.208905 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:17.208842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d" event={"ID":"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032","Type":"ContainerStarted","Data":"ab839b34959fcf6b8a0e1ea2ceea9beffd6aef27d9b7b900d1196f256db89f4f"}
Jun 09 02:32:19.221612 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:19.221578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d" event={"ID":"211ca0a9-6b1d-49de-8f5e-bb1b4eae2032","Type":"ContainerStarted","Data":"ad451c2641a26184665a50fc1b92c3e1de4a47625bf780ea514887092b0db3ff"}
Jun 09 02:32:19.222015 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:19.221704    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:19.240382 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:19.240328    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d" podStartSLOduration=1.5116445170000001 podStartE2EDuration="3.240309415s" totalImagesPullingTime="1.728664898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:19.237352566 +0000 UTC m=+736.711474219" watchObservedRunningTime="2026-06-09 02:32:19.240309415 +0000 UTC m=+736.714431070"
Jun 09 02:32:24.257274 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.257244    2576 generic.go:356] "Generic (PLEG): container finished" podID="492ad355-1eb6-4bb1-b141-bb095feae1aa" containerID="23160d9363854fba88cdbe3e5d74bf45d2ad5ee2e5097d05463b5b347b622f89" exitCode=0
Jun 09 02:32:24.257599 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.257314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" event={"ID":"492ad355-1eb6-4bb1-b141-bb095feae1aa","Type":"ContainerDied","Data":"23160d9363854fba88cdbe3e5d74bf45d2ad5ee2e5097d05463b5b347b622f89"}
Jun 09 02:32:24.257750 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.257726    2576 scope.go:117] "RemoveContainer" containerID="23160d9363854fba88cdbe3e5d74bf45d2ad5ee2e5097d05463b5b347b622f89"
Jun 09 02:32:24.258672 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.258641    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:32:24.258740 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.258725    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:32:24.258781 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:24.258771    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 09 02:32:25.236479 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.236438    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-6555d96656-df94d"
Jun 09 02:32:25.264912 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.264858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" event={"ID":"492ad355-1eb6-4bb1-b141-bb095feae1aa","Type":"ContainerStarted","Data":"af6ae6d261b90eab162cad51b6adc5fe84de03125a07a935f2f8ea11a70db200"}
Jun 09 02:32:25.563323 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.563235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:32:25.726929 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.726865    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:32:25.727927 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.727879    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g75fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 09 02:32:25.728047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:25.727964    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" podUID="492ad355-1eb6-4bb1-b141-bb095feae1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 09 02:32:26.727640 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:26.727603    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g75fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 09 02:32:26.728288 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:26.728223    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" podUID="492ad355-1eb6-4bb1-b141-bb095feae1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 09 02:32:27.727116 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:27.727075    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g75fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 09 02:32:27.727339 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:27.727140    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" podUID="492ad355-1eb6-4bb1-b141-bb095feae1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 09 02:32:28.727549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:28.727504    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g75fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 09 02:32:28.728045 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:28.727573    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn" podUID="492ad355-1eb6-4bb1-b141-bb095feae1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 09 02:32:29.731966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:29.731936    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:32:29.733012 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:32:29.732980    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g75fn"
Jun 09 02:33:16.594064 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.593983    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"]
Jun 09 02:33:16.599511 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.599493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.602185 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.602161    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 09 02:33:16.602298 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.602210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 09 02:33:16.603388 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.603372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fl7xf\""
Jun 09 02:33:16.603431 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.603408    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 09 02:33:16.607935 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.607914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"]
Jun 09 02:33:16.686433 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.686562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.686562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8f11-51f0-4884-b0dc-60121e2fb642-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.686562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gp48\" (UniqueName: \"kubernetes.io/projected/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kube-api-access-7gp48\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.686562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.686562 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.686531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787098 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787240 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787240 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787240 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787409 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8f11-51f0-4884-b0dc-60121e2fb642-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787464 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gp48\" (UniqueName: \"kubernetes.io/projected/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kube-api-access-7gp48\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787464 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787455    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787568 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787477    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.787568 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.787530    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.789353 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.789334    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ba8f11-51f0-4884-b0dc-60121e2fb642-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.789714 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.789693    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8f11-51f0-4884-b0dc-60121e2fb642-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.795115 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.795092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gp48\" (UniqueName: \"kubernetes.io/projected/d9ba8f11-51f0-4884-b0dc-60121e2fb642-kube-api-access-7gp48\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md\" (UID: \"d9ba8f11-51f0-4884-b0dc-60121e2fb642\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:16.911449 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:16.911392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:17.039176 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:17.039149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"]
Jun 09 02:33:17.041433 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:33:17.041399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ba8f11_51f0_4884_b0dc_60121e2fb642.slice/crio-1146609e2f07e1b6d74f55159d1e42f133841a4e0e9b121bba4854e5b2c6c0ef WatchSource:0}: Error finding container 1146609e2f07e1b6d74f55159d1e42f133841a4e0e9b121bba4854e5b2c6c0ef: Status 404 returned error can't find the container with id 1146609e2f07e1b6d74f55159d1e42f133841a4e0e9b121bba4854e5b2c6c0ef
Jun 09 02:33:17.522406 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:17.522371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md" event={"ID":"d9ba8f11-51f0-4884-b0dc-60121e2fb642","Type":"ContainerStarted","Data":"1146609e2f07e1b6d74f55159d1e42f133841a4e0e9b121bba4854e5b2c6c0ef"}
Jun 09 02:33:20.541956 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:20.541921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md" event={"ID":"d9ba8f11-51f0-4884-b0dc-60121e2fb642","Type":"ContainerStarted","Data":"6b8a664d58d62d2e572805630d8641b33bd3fcc9e237d16bda5ee1579348659a"}
Jun 09 02:33:24.562998 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:24.562964    2576 generic.go:356] "Generic (PLEG): container finished" podID="d9ba8f11-51f0-4884-b0dc-60121e2fb642" containerID="6b8a664d58d62d2e572805630d8641b33bd3fcc9e237d16bda5ee1579348659a" exitCode=0
Jun 09 02:33:24.563343 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:24.563036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md" event={"ID":"d9ba8f11-51f0-4884-b0dc-60121e2fb642","Type":"ContainerDied","Data":"6b8a664d58d62d2e572805630d8641b33bd3fcc9e237d16bda5ee1579348659a"}
Jun 09 02:33:26.576090 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:26.576059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md" event={"ID":"d9ba8f11-51f0-4884-b0dc-60121e2fb642","Type":"ContainerStarted","Data":"cef85c0270e1dd8bc703f749f3661c1503c62fe02a902a84b0683b91caba85a6"}
Jun 09 02:33:26.596231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:26.596186    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md" podStartSLOduration=2.938501592 podStartE2EDuration="10.596172436s" totalImagesPullingTime="4.520455238s" totalInitContainerRuntime="3.137215606s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:33:26.595377871 +0000 UTC m=+804.069499555" watchObservedRunningTime="2026-06-09 02:33:26.596172436 +0000 UTC m=+804.070294088"
Jun 09 02:33:26.912491 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:26.912429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:26.912491 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:26.912476    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:26.924902 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:26.924862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:27.592479 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:27.592447    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md"
Jun 09 02:33:33.280958 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.280920    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"]
Jun 09 02:33:33.286184 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.286165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.288746 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.288726    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 09 02:33:33.292801 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.292778    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"]
Jun 09 02:33:33.428454 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.428591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.428591 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.428723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.428723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pc2\" (UniqueName: \"kubernetes.io/projected/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kube-api-access-q7pc2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.428723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.428699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.529814 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.529787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.529966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.529825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pc2\" (UniqueName: \"kubernetes.io/projected/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kube-api-access-q7pc2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.529966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.529867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.529966 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.529903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.530117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.529984    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.530117 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.530032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.530315 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.530292    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.530397 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.530336    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.530397 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.530362    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.532169 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.532118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.532468 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.532450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.537261 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.537242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pc2\" (UniqueName: \"kubernetes.io/projected/4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee-kube-api-access-q7pc2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-d9w5q\" (UID: \"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.601251 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.601230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:33:33.733731 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:33.733702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"]
Jun 09 02:33:33.735650 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:33:33.735623    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5c7b2e_102c_4352_9cd5_fb922ce2f5ee.slice/crio-da83972f05d26b432fe2b775c9fda314a9fe39ecbf3878341945807fd721e5d5 WatchSource:0}: Error finding container da83972f05d26b432fe2b775c9fda314a9fe39ecbf3878341945807fd721e5d5: Status 404 returned error can't find the container with id da83972f05d26b432fe2b775c9fda314a9fe39ecbf3878341945807fd721e5d5
Jun 09 02:33:34.618133 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:34.618093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q" event={"ID":"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee","Type":"ContainerStarted","Data":"14e4aa7a6d7881ee4e6cbe6a0acddfd91146a87048532ec72b99c29599684d72"}
Jun 09 02:33:34.618476 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:34.618147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q" event={"ID":"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee","Type":"ContainerStarted","Data":"da83972f05d26b432fe2b775c9fda314a9fe39ecbf3878341945807fd721e5d5"}
Jun 09 02:33:36.892473 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:36.892439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"]
Jun 09 02:33:36.897865 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:36.897848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:36.900316 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:36.900295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 09 02:33:36.904703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:36.904677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"]
Jun 09 02:33:37.061572 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.061735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.061735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.061735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjntt\" (UniqueName: \"kubernetes.io/projected/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kube-api-access-rjntt\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.061735 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.061883 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.061778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.162867 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.162790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.162939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163047 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.162996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163175 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163175 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjntt\" (UniqueName: \"kubernetes.io/projected/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kube-api-access-rjntt\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163175 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163317 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163215    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163414 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163394    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.163471 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.163442    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.165056 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.165036    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.165411 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.165394    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.170789 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.170769    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjntt\" (UniqueName: \"kubernetes.io/projected/2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d-kube-api-access-rjntt\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr\" (UID: \"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.209674 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.209649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:37.341795 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.341763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"]
Jun 09 02:33:37.342797 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:33:37.342770    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6f0f76_89f8_45dc_8e0e_35313ef7fa6d.slice/crio-1c4861dd9a6a56496eeda83842aaa907e2bc8b338b212f88ea6e684f04d0a9f8 WatchSource:0}: Error finding container 1c4861dd9a6a56496eeda83842aaa907e2bc8b338b212f88ea6e684f04d0a9f8: Status 404 returned error can't find the container with id 1c4861dd9a6a56496eeda83842aaa907e2bc8b338b212f88ea6e684f04d0a9f8
Jun 09 02:33:37.636677 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.636641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr" event={"ID":"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d","Type":"ContainerStarted","Data":"083ff5ef775b9f514556f42a42698f5f55b77f448eaaeb301805868c5b124a15"}
Jun 09 02:33:37.636839 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:37.636697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr" event={"ID":"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d","Type":"ContainerStarted","Data":"1c4861dd9a6a56496eeda83842aaa907e2bc8b338b212f88ea6e684f04d0a9f8"}
Jun 09 02:33:38.642960 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:38.642935    2576 generic.go:356] "Generic (PLEG): container finished" podID="2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d" containerID="083ff5ef775b9f514556f42a42698f5f55b77f448eaaeb301805868c5b124a15" exitCode=0
Jun 09 02:33:38.643259 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:38.642998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr" event={"ID":"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d","Type":"ContainerDied","Data":"083ff5ef775b9f514556f42a42698f5f55b77f448eaaeb301805868c5b124a15"}
Jun 09 02:33:39.649874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:39.649842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr" event={"ID":"2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d","Type":"ContainerStarted","Data":"6650dd2f6599a69eba1939206d7c0cb20170d1564f41555a7f86c4550005728c"}
Jun 09 02:33:39.667311 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:39.667273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr" podStartSLOduration=2.258864407 podStartE2EDuration="3.667259265s" totalImagesPullingTime="186.433739ms" totalInitContainerRuntime="1.221961119s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:33:39.665787693 +0000 UTC m=+817.139909348" watchObservedRunningTime="2026-06-09 02:33:39.667259265 +0000 UTC m=+817.141380917"
Jun 09 02:33:43.987425 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:43.987387    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"]
Jun 09 02:33:43.992595 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:43.992573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:43.995023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:43.995001    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 09 02:33:44.001360 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.001340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"]
Jun 09 02:33:44.016915 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.016878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.017030 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.016982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.017030 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.017025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sz5t\" (UniqueName: \"kubernetes.io/projected/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kube-api-access-9sz5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.017122 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.017046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.017122 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.017071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.017235 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.017215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118619 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sz5t\" (UniqueName: \"kubernetes.io/projected/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kube-api-access-9sz5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118741 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.118989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.118779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.119141 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.119115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.119207 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.119145    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.119207 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.119160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.120874 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.120854    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.121070 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.121055    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.126078 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.126055    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sz5t\" (UniqueName: \"kubernetes.io/projected/d6e0584f-0361-4f5e-976f-a502a4e3c3f9-kube-api-access-9sz5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7\" (UID: \"d6e0584f-0361-4f5e-976f-a502a4e3c3f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.303102 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.303040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:44.434615 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.434591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"]
Jun 09 02:33:44.436178 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:33:44.436154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e0584f_0361_4f5e_976f_a502a4e3c3f9.slice/crio-185ce6d50178137f26f8401210adeae4afb897cea661653621d4f9f08487b6f0 WatchSource:0}: Error finding container 185ce6d50178137f26f8401210adeae4afb897cea661653621d4f9f08487b6f0: Status 404 returned error can't find the container with id 185ce6d50178137f26f8401210adeae4afb897cea661653621d4f9f08487b6f0
Jun 09 02:33:44.682419 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.682338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7" event={"ID":"d6e0584f-0361-4f5e-976f-a502a4e3c3f9","Type":"ContainerStarted","Data":"0413a8dcf8a29f792a95c5e0994c302f2a748ee9d79088569d6807f1d0a0a35a"}
Jun 09 02:33:44.682419 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:44.682399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7" event={"ID":"d6e0584f-0361-4f5e-976f-a502a4e3c3f9","Type":"ContainerStarted","Data":"185ce6d50178137f26f8401210adeae4afb897cea661653621d4f9f08487b6f0"}
Jun 09 02:33:47.210557 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.210484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:47.210557 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.210535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:47.223220 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.223201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:47.698687 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.698651    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6e0584f-0361-4f5e-976f-a502a4e3c3f9" containerID="0413a8dcf8a29f792a95c5e0994c302f2a748ee9d79088569d6807f1d0a0a35a" exitCode=0
Jun 09 02:33:47.698918 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.698726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7" event={"ID":"d6e0584f-0361-4f5e-976f-a502a4e3c3f9","Type":"ContainerDied","Data":"0413a8dcf8a29f792a95c5e0994c302f2a748ee9d79088569d6807f1d0a0a35a"}
Jun 09 02:33:47.710269 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:47.710245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr"
Jun 09 02:33:48.705637 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:48.705593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7" event={"ID":"d6e0584f-0361-4f5e-976f-a502a4e3c3f9","Type":"ContainerStarted","Data":"ea4338a627cfc74b120e88fbd79bd93d69639da95ffcf036f1fa7f070bc1bca3"}
Jun 09 02:33:48.723121 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:48.723031    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7" podStartSLOduration=3.233930929 podStartE2EDuration="5.72301135s" totalImagesPullingTime="152.758942ms" totalInitContainerRuntime="2.336321479s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:33:48.722508218 +0000 UTC m=+826.196629872" watchObservedRunningTime="2026-06-09 02:33:48.72301135 +0000 UTC m=+826.197133006"
Jun 09 02:33:54.303830 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:54.303801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:54.304317 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:54.303861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:54.315762 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:54.315740    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:33:54.750378 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:33:54.750342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7"
Jun 09 02:34:04.970072 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:04.970033    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"]
Jun 09 02:34:04.988998 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:04.988957    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"]
Jun 09 02:34:04.989160 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:04.989087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:04.991921 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:04.991870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 09 02:34:05.100415 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.100583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4943466c-94fb-45ac-af9e-1936128a2370-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.100583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnt9c\" (UniqueName: \"kubernetes.io/projected/4943466c-94fb-45ac-af9e-1936128a2370-kube-api-access-hnt9c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.100583 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.100705 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.100705 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.100623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.201944 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.201887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.201970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202248 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4943466c-94fb-45ac-af9e-1936128a2370-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202248 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnt9c\" (UniqueName: \"kubernetes.io/projected/4943466c-94fb-45ac-af9e-1936128a2370-kube-api-access-hnt9c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202357 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202357 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202525 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202494    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.202624 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.202607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.204215 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.204192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4943466c-94fb-45ac-af9e-1936128a2370-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.204484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.204467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4943466c-94fb-45ac-af9e-1936128a2370-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.210107 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.210085    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnt9c\" (UniqueName: \"kubernetes.io/projected/4943466c-94fb-45ac-af9e-1936128a2370-kube-api-access-hnt9c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j2dbr\" (UID: \"4943466c-94fb-45ac-af9e-1936128a2370\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.300723 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.300703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:05.635201 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.635174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"]
Jun 09 02:34:05.636788 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:34:05.636760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4943466c_94fb_45ac_af9e_1936128a2370.slice/crio-fc14c6c3c708e5e2c69c158f809e328c3ed0233d4a4854faaa7e7b00e398245c WatchSource:0}: Error finding container fc14c6c3c708e5e2c69c158f809e328c3ed0233d4a4854faaa7e7b00e398245c: Status 404 returned error can't find the container with id fc14c6c3c708e5e2c69c158f809e328c3ed0233d4a4854faaa7e7b00e398245c
Jun 09 02:34:05.798155 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.798117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr" event={"ID":"4943466c-94fb-45ac-af9e-1936128a2370","Type":"ContainerStarted","Data":"58a290f293e2ce3c30756d3db1604b2713800497466c44610376a7733468ae90"}
Jun 09 02:34:05.798155 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:05.798157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr" event={"ID":"4943466c-94fb-45ac-af9e-1936128a2370","Type":"ContainerStarted","Data":"fc14c6c3c708e5e2c69c158f809e328c3ed0233d4a4854faaa7e7b00e398245c"}
Jun 09 02:34:07.809945 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:07.809915    2576 generic.go:356] "Generic (PLEG): container finished" podID="4943466c-94fb-45ac-af9e-1936128a2370" containerID="58a290f293e2ce3c30756d3db1604b2713800497466c44610376a7733468ae90" exitCode=0
Jun 09 02:34:07.810311 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:07.809965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr" event={"ID":"4943466c-94fb-45ac-af9e-1936128a2370","Type":"ContainerDied","Data":"58a290f293e2ce3c30756d3db1604b2713800497466c44610376a7733468ae90"}
Jun 09 02:34:08.817656 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:08.817624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr" event={"ID":"4943466c-94fb-45ac-af9e-1936128a2370","Type":"ContainerStarted","Data":"402b2b0e86a11481b9382af52872fe95bb0ee1bb3d8ddd727b006f9107e9e0f0"}
Jun 09 02:34:08.835588 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:08.835536    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr" podStartSLOduration=3.335994384 podStartE2EDuration="4.83551741s" totalImagesPullingTime="205.467714ms" totalInitContainerRuntime="1.294055312s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:34:08.834408498 +0000 UTC m=+846.308530143" watchObservedRunningTime="2026-06-09 02:34:08.83551741 +0000 UTC m=+846.309639062"
Jun 09 02:34:15.301387 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:15.301354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:15.301778 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:15.301401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:15.313714 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:15.313691    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:34:15.864648 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:34:15.864623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j2dbr"
Jun 09 02:35:03.007321 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:03.007232    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:35:03.008082 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:03.008060    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:35:21.180262 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:21.180229    2576 generic.go:356] "Generic (PLEG): container finished" podID="4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee" containerID="14e4aa7a6d7881ee4e6cbe6a0acddfd91146a87048532ec72b99c29599684d72" exitCode=0
Jun 09 02:35:21.180676 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:21.180297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q" event={"ID":"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee","Type":"ContainerDied","Data":"14e4aa7a6d7881ee4e6cbe6a0acddfd91146a87048532ec72b99c29599684d72"}
Jun 09 02:35:22.186989 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:22.186957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q" event={"ID":"4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee","Type":"ContainerStarted","Data":"f418a0fe53264fb2c67282a460d40df64cc109619b9f3687159b85d04e20f52a"}
Jun 09 02:35:22.204887 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:22.204837    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q" podStartSLOduration=2.123042908 podStartE2EDuration="1m49.204822711s" totalImagesPullingTime="191.691261ms" totalInitContainerRuntime="1m46.890088542s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:35:22.20430693 +0000 UTC m=+919.678428586" watchObservedRunningTime="2026-06-09 02:35:22.204822711 +0000 UTC m=+919.678944361"
Jun 09 02:35:23.601732 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:23.601702    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:35:23.602134 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:23.601787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:35:23.613702 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:23.613681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:35:24.207541 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:35:24.207514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-d9w5q"
Jun 09 02:36:13.615396 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.615364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:36:13.615959 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.615536    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" podUID="c133daee-3be5-490f-8a98-39c649350cd2" containerName="manager" containerID="cri-o://28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1" gracePeriod=30
Jun 09 02:36:13.867811 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.867757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:36:13.938887 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.938862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg2mj\" (UniqueName: \"kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj\") pod \"c133daee-3be5-490f-8a98-39c649350cd2\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") "
Jun 09 02:36:13.939036 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.938996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert\") pod \"c133daee-3be5-490f-8a98-39c649350cd2\" (UID: \"c133daee-3be5-490f-8a98-39c649350cd2\") "
Jun 09 02:36:13.940689 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.940660    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj" (OuterVolumeSpecName: "kube-api-access-sg2mj") pod "c133daee-3be5-490f-8a98-39c649350cd2" (UID: "c133daee-3be5-490f-8a98-39c649350cd2"). InnerVolumeSpecName "kube-api-access-sg2mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 02:36:13.940843 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:13.940829    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c133daee-3be5-490f-8a98-39c649350cd2" (UID: "c133daee-3be5-490f-8a98-39c649350cd2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 02:36:14.040116 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.040090    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg2mj\" (UniqueName: \"kubernetes.io/projected/c133daee-3be5-490f-8a98-39c649350cd2-kube-api-access-sg2mj\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:36:14.040116 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.040112    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c133daee-3be5-490f-8a98-39c649350cd2-webhook-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 02:36:14.455273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.455202    2576 generic.go:356] "Generic (PLEG): container finished" podID="c133daee-3be5-490f-8a98-39c649350cd2" containerID="28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1" exitCode=0
Jun 09 02:36:14.455273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.455243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9"
Jun 09 02:36:14.455273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.455255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" event={"ID":"c133daee-3be5-490f-8a98-39c649350cd2","Type":"ContainerDied","Data":"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"}
Jun 09 02:36:14.455477 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.455317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-wtkk9" event={"ID":"c133daee-3be5-490f-8a98-39c649350cd2","Type":"ContainerDied","Data":"e2a05457d1393be6b91da902f24ab2780d69af341ce43c86b5832c67210548f8"}
Jun 09 02:36:14.455477 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.455351    2576 scope.go:117] "RemoveContainer" containerID="28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"
Jun 09 02:36:14.464578 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.464560    2576 scope.go:117] "RemoveContainer" containerID="28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"
Jun 09 02:36:14.464821 ip-10-0-128-73 kubenswrapper[2576]: E0609 02:36:14.464805    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1\": container with ID starting with 28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1 not found: ID does not exist" containerID="28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"
Jun 09 02:36:14.464869 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.464831    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1"} err="failed to get container status \"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1\": rpc error: code = NotFound desc = could not find container \"28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1\": container with ID starting with 28e601ee72cd168f921a64bf7a41c08e766cd62da6b92bed0b61dce6373fe5d1 not found: ID does not exist"
Jun 09 02:36:14.481742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.481720    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:36:14.484172 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.484154    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-wtkk9"]
Jun 09 02:36:14.982128 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:36:14.982092    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c133daee-3be5-490f-8a98-39c649350cd2" path="/var/lib/kubelet/pods/c133daee-3be5-490f-8a98-39c649350cd2/volumes"
Jun 09 02:40:03.040465 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:40:03.040440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:40:03.042231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:40:03.042210    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:45:03.073342 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:45:03.073318    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:45:03.076231 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:45:03.076207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:50:03.108170 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:50:03.108131    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:50:03.111734 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:50:03.111716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:55:03.149531 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:55:03.149503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:55:03.155564 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:55:03.155543    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:57:43.929802 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:43.929768    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f6f7c76-jg4g5_28656746-c6a1-4f12-84c9-c15373665d0f/nginx/0.log"
Jun 09 02:57:44.142881 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.142850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dfqk5_aced19c1-ae78-4f7b-b466-dfa1e13ed0a8/manager/0.log"
Jun 09 02:57:44.260439 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.260405    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8vf26_38c09b4a-3a54-4d89-9158-ff294ff4a62c/manager/0.log"
Jun 09 02:57:44.493762 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.493733    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lp5xt_da6f4186-1248-4f08-986c-c39e6ee02046/server/0.log"
Jun 09 02:57:44.612689 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.612598    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zzl4l_5601209e-4526-4f91-aa52-fa2b82eb897b/manager/0.log"
Jun 09 02:57:44.719549 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.719520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-4j6xl_59d53a29-dd55-461a-9cdd-ea42c510944e/copy-manifests/0.log"
Jun 09 02:57:44.738070 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:44.738038    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-4j6xl_59d53a29-dd55-461a-9cdd-ea42c510944e/manager/0.log"
Jun 09 02:57:46.327497 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:46.327470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9j8gb_c9d1f1bf-45ec-4bde-947a-d47ae9a8e204/manager/0.log"
Jun 09 02:57:47.441212 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:47.441184    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f5z2s_1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3/discovery/0.log"
Jun 09 02:57:47.551135 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:47.551104    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-bwfs4_882eb9bd-1a52-44ab-beb8-f1920a61206d/kube-auth-proxy/0.log"
Jun 09 02:57:47.779448 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:47.779416    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/1.log"
Jun 09 02:57:47.888284 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:47.888257    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:57:48.216265 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.216181    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md_d9ba8f11-51f0-4884-b0dc-60121e2fb642/storage-initializer/0.log"
Jun 09 02:57:48.223703 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.223682    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ds8md_d9ba8f11-51f0-4884-b0dc-60121e2fb642/main/0.log"
Jun 09 02:57:48.336174 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.336149    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-d9w5q_4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee/storage-initializer/0.log"
Jun 09 02:57:48.344234 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.344209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-d9w5q_4a5c7b2e-102c-4352-9cd5-fb922ce2f5ee/main/0.log"
Jun 09 02:57:48.449565 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.449542    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr_2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d/storage-initializer/0.log"
Jun 09 02:57:48.457175 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.457150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-xrpgr_2d6f0f76-89f8-45dc-8e0e-35313ef7fa6d/main/0.log"
Jun 09 02:57:48.562559 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.562533    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7_d6e0584f-0361-4f5e-976f-a502a4e3c3f9/storage-initializer/0.log"
Jun 09 02:57:48.570488 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.570469    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctcbq7_d6e0584f-0361-4f5e-976f-a502a4e3c3f9/main/0.log"
Jun 09 02:57:48.793417 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.793393    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j2dbr_4943466c-94fb-45ac-af9e-1936128a2370/storage-initializer/0.log"
Jun 09 02:57:48.801531 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:48.801512    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j2dbr_4943466c-94fb-45ac-af9e-1936128a2370/main/0.log"
Jun 09 02:57:55.852780 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:55.852745    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6hng4_5e83470f-9c46-4ede-a475-c42e413676ce/global-pull-secret-syncer/0.log"
Jun 09 02:57:56.011432 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:56.011401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7hq52_028f4486-012b-42f5-827b-c85720a09d46/konnectivity-agent/0.log"
Jun 09 02:57:56.065576 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:56.065531    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-73.ec2.internal_58267d6e6471fb16c1b68a4f6cfaa490/haproxy/0.log"
Jun 09 02:57:59.392696 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:57:59.392665    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-x96nt_fb088be3-5d3a-4ed6-98f6-eba4a5f0829c/sail-operator/0.log"
Jun 09 02:58:01.217943 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:01.217913    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9j8gb_c9d1f1bf-45ec-4bde-947a-d47ae9a8e204/manager/0.log"
Jun 09 02:58:02.959884 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:02.959809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/alertmanager/0.log"
Jun 09 02:58:02.987087 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:02.987064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/config-reloader/0.log"
Jun 09 02:58:03.008373 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.008352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/kube-rbac-proxy-web/0.log"
Jun 09 02:58:03.029085 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.029065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/kube-rbac-proxy/0.log"
Jun 09 02:58:03.049983 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.049960    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/kube-rbac-proxy-metric/0.log"
Jun 09 02:58:03.070926 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.070907    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/prom-label-proxy/0.log"
Jun 09 02:58:03.093205 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.093178    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c47b5a3-4959-4834-a6a5-dcd66663f3ea/init-config-reloader/0.log"
Jun 09 02:58:03.239513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.239486    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d7fcbc986-xpmzs_d0dae03d-2873-4005-838f-ee960f835e16/metrics-server/0.log"
Jun 09 02:58:03.264169 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.264134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-hw6fs_61f8f75f-a25a-45c2-8004-c68a42f746d6/monitoring-plugin/0.log"
Jun 09 02:58:03.306742 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.306721    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/node-exporter/0.log"
Jun 09 02:58:03.326000 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.325978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/kube-rbac-proxy/0.log"
Jun 09 02:58:03.348167 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.348148    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mlz4_e62c94ee-75fd-4617-a63f-56d365194e66/init-textfile/0.log"
Jun 09 02:58:03.524584 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.524497    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/kube-rbac-proxy-main/0.log"
Jun 09 02:58:03.543543 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.543520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/kube-rbac-proxy-self/0.log"
Jun 09 02:58:03.569056 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.569032    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2mrj7_294b6a7c-d108-4ff7-9512-8d6ee39ccb13/openshift-state-metrics/0.log"
Jun 09 02:58:03.612317 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.612301    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/prometheus/0.log"
Jun 09 02:58:03.635585 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.635564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/config-reloader/0.log"
Jun 09 02:58:03.657674 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.657658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/thanos-sidecar/0.log"
Jun 09 02:58:03.682949 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.682931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/kube-rbac-proxy-web/0.log"
Jun 09 02:58:03.725944 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.725920    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/kube-rbac-proxy/0.log"
Jun 09 02:58:03.753612 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.753593    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/kube-rbac-proxy-thanos/0.log"
Jun 09 02:58:03.780303 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.780239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a94b321-5d87-4119-ba40-4c6bf873ce1e/init-config-reloader/0.log"
Jun 09 02:58:03.874044 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:03.874021    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-x9qp7_c78dbdc6-74a9-45b6-bc5a-d73e2ef84826/prometheus-operator-admission-webhook/0.log"
Jun 09 02:58:07.232524 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.232490    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-6455p_cbacd8fb-cb16-4091-87b7-eec245cb2f4b/volume-data-source-validator/0.log"
Jun 09 02:58:07.288831 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.288801    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"]
Jun 09 02:58:07.289421 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.289307    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133daee-3be5-490f-8a98-39c649350cd2" containerName="manager"
Jun 09 02:58:07.289421 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.289328    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133daee-3be5-490f-8a98-39c649350cd2" containerName="manager"
Jun 09 02:58:07.289587 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.289427    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133daee-3be5-490f-8a98-39c649350cd2" containerName="manager"
Jun 09 02:58:07.292305 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.292288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.294795 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.294773    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"kube-root-ca.crt\""
Jun 09 02:58:07.295827 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.295810    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"openshift-service-ca.crt\""
Jun 09 02:58:07.295938 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.295813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xdkm6\"/\"default-dockercfg-xh6kn\""
Jun 09 02:58:07.300818 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.300797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"]
Jun 09 02:58:07.325273 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.325253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-podres\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.325372 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.325280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-proc\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.325372 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.325320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-lib-modules\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.325450 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.325371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxpx\" (UniqueName: \"kubernetes.io/projected/651e254e-49ee-4e4b-9a13-3003757c9569-kube-api-access-4fxpx\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.325484 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.325462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-sys\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426387 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-sys\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-podres\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-proc\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426483 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-lib-modules\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-sys\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxpx\" (UniqueName: \"kubernetes.io/projected/651e254e-49ee-4e4b-9a13-3003757c9569-kube-api-access-4fxpx\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426530    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-podres\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426577    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-proc\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.426642 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.426619    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/651e254e-49ee-4e4b-9a13-3003757c9569-lib-modules\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.433718 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.433699    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxpx\" (UniqueName: \"kubernetes.io/projected/651e254e-49ee-4e4b-9a13-3003757c9569-kube-api-access-4fxpx\") pod \"perf-node-gather-daemonset-wx2lg\" (UID: \"651e254e-49ee-4e4b-9a13-3003757c9569\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.602733 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.602675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:07.728837 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:07.728806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"]
Jun 09 02:58:07.730407 ip-10-0-128-73 kubenswrapper[2576]: W0609 02:58:07.730377    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod651e254e_49ee_4e4b_9a13_3003757c9569.slice/crio-faf260beefe3271be329d85d42f6caa3158249951f34b7183cec8ebc93200513 WatchSource:0}: Error finding container faf260beefe3271be329d85d42f6caa3158249951f34b7183cec8ebc93200513: Status 404 returned error can't find the container with id faf260beefe3271be329d85d42f6caa3158249951f34b7183cec8ebc93200513
Jun 09 02:58:08.362356 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.362321    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5gxr_edd2eab8-cc93-40eb-9564-6d1307ceeb2f/dns/0.log"
Jun 09 02:58:08.382370 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.382334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5gxr_edd2eab8-cc93-40eb-9564-6d1307ceeb2f/kube-rbac-proxy/0.log"
Jun 09 02:58:08.391395 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.391371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg" event={"ID":"651e254e-49ee-4e4b-9a13-3003757c9569","Type":"ContainerStarted","Data":"8b6970bcdb7da8326d426d474da4e47da3e421105147daddf88ff1507bd9b850"}
Jun 09 02:58:08.391490 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.391416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg" event={"ID":"651e254e-49ee-4e4b-9a13-3003757c9569","Type":"ContainerStarted","Data":"faf260beefe3271be329d85d42f6caa3158249951f34b7183cec8ebc93200513"}
Jun 09 02:58:08.391567 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.391548    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:08.406168 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.406129    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg" podStartSLOduration=1.406115243 podStartE2EDuration="1.406115243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:58:08.40562073 +0000 UTC m=+2285.879742384" watchObservedRunningTime="2026-06-09 02:58:08.406115243 +0000 UTC m=+2285.880236890"
Jun 09 02:58:08.492586 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:08.492566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-758bx_26354ed2-3f22-48d7-8f95-3dabdefe0281/dns-node-resolver/0.log"
Jun 09 02:58:09.035109 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:09.035082    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx8ql_11589df6-dafd-4ce7-8ed8-d4ccfc8a0ba3/node-ca/0.log"
Jun 09 02:58:10.065029 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.065008    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f5z2s_1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3/discovery/0.log"
Jun 09 02:58:10.083224 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.083200    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-bwfs4_882eb9bd-1a52-44ab-beb8-f1920a61206d/kube-auth-proxy/0.log"
Jun 09 02:58:10.136172 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.136153    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/0.log"
Jun 09 02:58:10.202023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.201997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/1.log"
Jun 09 02:58:10.221132 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.221109    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:58:10.775532 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:10.775506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lwmp_933e1b22-dac8-43de-acbd-7848442bbde1/serve-healthcheck-canary/0.log"
Jun 09 02:58:11.374714 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:11.374682    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwnfb_38895731-1bea-43f8-8cff-c7d76b4451fc/kube-rbac-proxy/0.log"
Jun 09 02:58:11.393663 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:11.393638    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwnfb_38895731-1bea-43f8-8cff-c7d76b4451fc/exporter/0.log"
Jun 09 02:58:11.413074 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:11.413052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwnfb_38895731-1bea-43f8-8cff-c7d76b4451fc/extractor/0.log"
Jun 09 02:58:13.578995 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:13.578957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f6f7c76-jg4g5_28656746-c6a1-4f12-84c9-c15373665d0f/nginx/0.log"
Jun 09 02:58:13.625485 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:13.625459    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dfqk5_aced19c1-ae78-4f7b-b466-dfa1e13ed0a8/manager/0.log"
Jun 09 02:58:13.768503 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:13.768479    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8vf26_38c09b4a-3a54-4d89-9158-ff294ff4a62c/manager/0.log"
Jun 09 02:58:13.872054 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:13.871991    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lp5xt_da6f4186-1248-4f08-986c-c39e6ee02046/server/0.log"
Jun 09 02:58:13.942771 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:13.942749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zzl4l_5601209e-4526-4f91-aa52-fa2b82eb897b/manager/0.log"
Jun 09 02:58:14.101690 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:14.101665    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-4j6xl_59d53a29-dd55-461a-9cdd-ea42c510944e/manager/0.log"
Jun 09 02:58:14.123412 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:14.123357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-4j6xl_59d53a29-dd55-461a-9cdd-ea42c510944e/copy-manifests/0.log"
Jun 09 02:58:14.404817 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:14.404758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-wx2lg"
Jun 09 02:58:15.712522 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:15.712478    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pmww8_418bc801-c164-462d-9de5-e581ec6aba0d/openshift-lws-operator/0.log"
Jun 09 02:58:19.843289 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:19.843258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f5z2s_1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3/discovery/0.log"
Jun 09 02:58:19.853135 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:19.853109    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-bwfs4_882eb9bd-1a52-44ab-beb8-f1920a61206d/kube-auth-proxy/0.log"
Jun 09 02:58:19.889513 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:19.889486    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/0.log"
Jun 09 02:58:19.961851 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:19.961816    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/1.log"
Jun 09 02:58:19.975764 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:19.975739    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:58:20.778999 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:20.778967    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vbx7b_2abd80d6-bb90-4d50-be83-22497de753b9/migrator/0.log"
Jun 09 02:58:20.799712 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:20.799689    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vbx7b_2abd80d6-bb90-4d50-be83-22497de753b9/graceful-termination/0.log"
Jun 09 02:58:21.223584 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.223506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-cfs9q_b70d6ccb-8c58-4102-96d6-c7877fc49915/kube-storage-version-migrator-operator/1.log"
Jun 09 02:58:21.225817 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.225794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-cfs9q_b70d6ccb-8c58-4102-96d6-c7877fc49915/kube-storage-version-migrator-operator/0.log"
Jun 09 02:58:21.275307 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.275280    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f5z2s_1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3/discovery/0.log"
Jun 09 02:58:21.286546 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.286524    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-bwfs4_882eb9bd-1a52-44ab-beb8-f1920a61206d/kube-auth-proxy/0.log"
Jun 09 02:58:21.325364 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.325339    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/0.log"
Jun 09 02:58:21.394184 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.394166    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/1.log"
Jun 09 02:58:21.407291 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:21.407273    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:58:22.410207 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.410178    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/kube-multus-additional-cni-plugins/0.log"
Jun 09 02:58:22.433415 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.433392    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/egress-router-binary-copy/0.log"
Jun 09 02:58:22.452272 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.452251    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/cni-plugins/0.log"
Jun 09 02:58:22.471354 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.471334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/bond-cni-plugin/0.log"
Jun 09 02:58:22.490202 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.490183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/routeoverride-cni/0.log"
Jun 09 02:58:22.509015 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.508998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/whereabouts-cni-bincopy/0.log"
Jun 09 02:58:22.528286 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.528267    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pxd9_be7b16f6-1842-4335-a815-65c29230016a/whereabouts-cni/0.log"
Jun 09 02:58:22.901157 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.901112    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rmm89_15b79ddd-1050-43e2-889d-b7c7bec1d7be/kube-multus/0.log"
Jun 09 02:58:22.965247 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.965221    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gnvkg_e70df090-e6a8-49c3-a22f-25e688e969a6/network-metrics-daemon/0.log"
Jun 09 02:58:22.981444 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.981415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gnvkg_e70df090-e6a8-49c3-a22f-25e688e969a6/kube-rbac-proxy/0.log"
Jun 09 02:58:22.993092 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:22.993069    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f5z2s_1e0415df-6e5b-4f5f-80be-7c7c66f8b5a3/discovery/0.log"
Jun 09 02:58:23.004092 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:23.004068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5687f7b7-bwfs4_882eb9bd-1a52-44ab-beb8-f1920a61206d/kube-auth-proxy/0.log"
Jun 09 02:58:23.033997 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:23.033932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/0.log"
Jun 09 02:58:23.098926 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:23.098886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g75fn_492ad355-1eb6-4bb1-b141-bb095feae1aa/istio-proxy/1.log"
Jun 09 02:58:23.127203 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:23.127180    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49cbd847-xhn2t_f6a58053-2c7d-4c1f-8f18-cba5098b28ae/router/0.log"
Jun 09 02:58:24.347028 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.346996    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-controller/0.log"
Jun 09 02:58:24.361763 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.361741    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/0.log"
Jun 09 02:58:24.361916 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.361772    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovn-acl-logging/1.log"
Jun 09 02:58:24.382822 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.382800    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/kube-rbac-proxy-node/0.log"
Jun 09 02:58:24.404864 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.404845    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/kube-rbac-proxy-ovn-metrics/0.log"
Jun 09 02:58:24.421414 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.421397    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/northd/0.log"
Jun 09 02:58:24.440645 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.440583    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/nbdb/0.log"
Jun 09 02:58:24.462023 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.462001    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/sbdb/0.log"
Jun 09 02:58:24.529358 ip-10-0-128-73 kubenswrapper[2576]: I0609 02:58:24.529326    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjhqc_0deea437-1482-4f29-95c5-0e51bc5ba2a4/ovnkube-controller/0.log"