May 25 12:12:10.518483 ip-10-0-130-54 systemd[1]: Starting Kubernetes Kubelet...
May 25 12:12:11.016936 ip-10-0-130-54 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 12:12:11.016936 ip-10-0-130-54 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 12:12:11.016936 ip-10-0-130-54 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 12:12:11.016936 ip-10-0-130-54 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 12:12:11.016936 ip-10-0-130-54 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 12:12:11.018663 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.018589    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 12:12:11.022374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022359    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 12:12:11.022374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022373    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022378    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022381    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022384    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022387    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022390    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022393    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022395    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022398    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022401    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022403    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022406    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022410    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022413    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022415    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022418    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022421    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022429    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022432    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022434    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 12:12:11.022435 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022438    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022443    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022446    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022449    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022452    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022454    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022457    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022460    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022463    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022465    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022468    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022470    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022472    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022475    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022477    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022480    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022482    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022485    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022487    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022490    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 12:12:11.022918 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022492    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022495    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022497    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022499    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022503    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022507    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022510    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022512    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022515    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022518    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022522    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022524    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022527    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022530    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022533    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022535    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022538    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022541    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022543    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 12:12:11.023424 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022546    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022548    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022551    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022553    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022556    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022558    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022561    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022563    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022566    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022569    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022572    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022574    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022578    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022581    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022583    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022586    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022589    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022592    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022594    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022597    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 12:12:11.023881 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022600    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022602    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022605    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022608    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022610    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022613    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022976    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022981    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022984    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022986    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022990    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022993    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022995    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.022998    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023000    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023003    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023006    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023008    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023011    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023013    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 12:12:11.024374 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023016    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023018    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023021    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023023    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023026    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023029    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023032    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023034    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023038    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023042    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023044    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023047    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023058    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023061    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023064    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023067    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023070    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023072    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023075    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 12:12:11.024845 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023078    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023081    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023084    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023087    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023089    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023092    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023094    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023097    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023099    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023102    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023104    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023107    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023109    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023111    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023114    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023118    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023121    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023123    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023126    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023129    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 12:12:11.025326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023132    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023134    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023137    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023139    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023142    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023145    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023148    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023151    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023154    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023156    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023159    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023161    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023164    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023166    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023169    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023171    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023174    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023176    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023179    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023181    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 12:12:11.025806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023184    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023186    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023189    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023191    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023194    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023211    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023215    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023218    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023220    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023223    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023225    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023228    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.023231    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024690    2575 flags.go:64] FLAG: --address="0.0.0.0"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024700    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024707    2575 flags.go:64] FLAG: --anonymous-auth="true"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024712    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024717    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024720    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024725    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024730    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 12:12:11.026326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024733    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024736    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024740    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024743    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024746    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024749    2575 flags.go:64] FLAG: --cgroup-root=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024752    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024756    2575 flags.go:64] FLAG: --client-ca-file=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024759    2575 flags.go:64] FLAG: --cloud-config=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024761    2575 flags.go:64] FLAG: --cloud-provider="external"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024764    2575 flags.go:64] FLAG: --cluster-dns="[]"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024768    2575 flags.go:64] FLAG: --cluster-domain=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024771    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024774    2575 flags.go:64] FLAG: --config-dir=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024777    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024780    2575 flags.go:64] FLAG: --container-log-max-files="5"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024784    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024787    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024790    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024793    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024796    2575 flags.go:64] FLAG: --contention-profiling="false"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024799    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024802    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024806    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024809    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 12:12:11.026837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024813    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024816    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024819    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024822    2575 flags.go:64] FLAG: --enable-load-reader="false"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024825    2575 flags.go:64] FLAG: --enable-server="true"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024828    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024834    2575 flags.go:64] FLAG: --event-burst="100"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024837    2575 flags.go:64] FLAG: --event-qps="50"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024840    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024844    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024847    2575 flags.go:64] FLAG: --eviction-hard=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024851    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024854    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024857    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024860    2575 flags.go:64] FLAG: --eviction-soft=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024863    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024866    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024869    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024872    2575 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024875    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024878    2575 flags.go:64] FLAG: --fail-swap-on="true"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024880    2575 flags.go:64] FLAG: --feature-gates=""
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024884    2575 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024887    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024890    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 12:12:11.027468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024893    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024896    2575 flags.go:64] FLAG: --healthz-port="10248"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024900    2575 flags.go:64] FLAG: --help="false"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024903    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024906    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024909    2575 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024912    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024916    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024919    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024922    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024925    2575 flags.go:64] FLAG: --image-service-endpoint=""
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024928    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024931    2575 flags.go:64] FLAG: --kube-api-burst="100"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024934    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024937    2575 flags.go:64] FLAG: --kube-api-qps="50"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024940    2575 flags.go:64] FLAG: --kube-reserved=""
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024943    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024946    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024949    2575 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024952    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024954    2575 flags.go:64] FLAG: --lock-file=""
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024957    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024960    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024963    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 12:12:11.028107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024968    2575 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024971    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024974    2575 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024977    2575 flags.go:64] FLAG: --logging-format="text"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024980    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024983    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024986    2575 flags.go:64] FLAG: --manifest-url=""
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024989    2575 flags.go:64] FLAG: --manifest-url-header=""
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024993    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.024996    2575 flags.go:64] FLAG: --max-open-files="1000000"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025001    2575 flags.go:64] FLAG: --max-pods="110"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025003    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025006    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025009    2575 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025012    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025016    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025019    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025022    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025029    2575 flags.go:64] FLAG: --node-status-max-images="50"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025032    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025035    2575 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025038    2575 flags.go:64] FLAG: --pod-cidr=""
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025041    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 12:12:11.028691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025047    2575 flags.go:64] FLAG: --pod-manifest-path=""
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025050    2575 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025053    2575 flags.go:64] FLAG: --pods-per-core="0"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025056    2575 flags.go:64] FLAG: --port="10250"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025059    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025062    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e1274649699fcc99"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025066    2575 flags.go:64] FLAG: --qos-reserved=""
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025068    2575 flags.go:64] FLAG: --read-only-port="10255"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025071    2575 flags.go:64] FLAG: --register-node="true"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025074    2575 flags.go:64] FLAG: --register-schedulable="true"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025077    2575 flags.go:64] FLAG: --register-with-taints=""
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025081    2575 flags.go:64] FLAG: --registry-burst="10"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025084    2575 flags.go:64] FLAG: --registry-qps="5"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025087    2575 flags.go:64] FLAG: --reserved-cpus=""
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025090    2575 flags.go:64] FLAG: --reserved-memory=""
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025093    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025096    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025099    2575 flags.go:64] FLAG: --rotate-certificates="false"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025102    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025105    2575 flags.go:64] FLAG: --runonce="false"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025108    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025112    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025115    2575 flags.go:64] FLAG: --seccomp-default="false"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025118    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025121    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025124    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 12:12:11.029279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025128    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025131    2575 flags.go:64] FLAG: --storage-driver-password="root"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025134    2575 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025136    2575 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025139    2575 flags.go:64] FLAG: --storage-driver-user="root"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025142    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025145    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025148    2575 flags.go:64] FLAG: --system-cgroups=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025151    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025156    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025158    2575 flags.go:64] FLAG: --tls-cert-file=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025161    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025165    2575 flags.go:64] FLAG: --tls-min-version=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025168    2575 flags.go:64] FLAG: --tls-private-key-file=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025171    2575 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025173    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025176    2575 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025179    2575 flags.go:64] FLAG: --v="2"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025184    2575 flags.go:64] FLAG: --version="false"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025187    2575 flags.go:64] FLAG: --vmodule=""
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025191    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.025194    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025293    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025297    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 12:12:11.029901 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025300    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025303    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025306    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025309    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025312    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025315    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025317    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025320    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025323    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025327    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025330    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025333    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025335    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025338    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025341    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025343    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025346    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025349    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025351    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025354    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 12:12:11.030552 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025357    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025359    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025362    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025364    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025367    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025369    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025372    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025374    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025377    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025380    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025382    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025385    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025387    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025390    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025393    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025395    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025398    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025401    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025403    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025406    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 12:12:11.031057 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025408    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025413    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025416    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025419    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025421    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025424    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025426    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025429    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025431    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025434    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025436    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025439    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025442    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025444    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025446    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025449    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025451    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025454    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025456    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 12:12:11.031858 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025459    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025461    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025464    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025467    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025469    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025472    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025474    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025477    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025479    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025482    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025484    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025487    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025491    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025495    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025498    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025502    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025504    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025507    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025510    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 12:12:11.032676 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025513    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025515    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025518    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025521    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025523    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.025526    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 12:12:11.033482 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.026214    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.033413    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.033548    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033622    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033630    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033635    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033640    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033644    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033649    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033654    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033658    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033663    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033667    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033672    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033677    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033681    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033688    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033696    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033702    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 12:12:11.033788 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033706    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033711    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033715    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033720    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033724    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033728    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033732    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033736    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033740    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033744    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033748    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033752    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033756    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033761    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033765    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033772    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033777    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033782    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033786    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033790    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 12:12:11.034727 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033794    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033798    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033803    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033807    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033811    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033816    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033820    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033825    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033829    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033833    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033837    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033842    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033846    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033850    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033854    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033858    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033862    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033867    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033871    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033875    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 12:12:11.035260 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033880    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033884    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033889    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033893    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033897    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033902    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033906    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033911    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033918    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033925    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033930    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033934    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033938    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033942    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033946    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033951    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033955    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033959    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033964    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 12:12:11.035813 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033968    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033972    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033976    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033980    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033985    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033989    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033993    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.033997    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034001    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034006    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034009    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.034017    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034170    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034179    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034183    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034188    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 12:12:11.036438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034193    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034215    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034220    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034224    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034228    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034233    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034238    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034242    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034246    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034250    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034254    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034258    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034262    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034265    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034269    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034273    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034277    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034281    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034287    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 12:12:11.036920 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034292    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034296    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034300    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034305    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034311    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034314    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034319    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034323    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034327    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034332    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034336    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034340    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034344    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034348    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034352    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034356    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034360    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034364    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034369    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 12:12:11.037434 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034373    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034378    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034382    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034387    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034391    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034395    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034399    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034403    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034407    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034412    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034416    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034420    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034424    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034428    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034432    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034436    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034440    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034444    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034448    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034452    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 12:12:11.037905 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034457    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034461    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034465    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034469    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034473    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034477    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034481    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034485    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034489    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034493    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034497    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034502    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034506    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034510    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034514    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034519    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034523    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034527    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034531    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034534    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 12:12:11.038471 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034539    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 12:12:11.038953 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034543    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 12:12:11.038953 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034547    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 12:12:11.038953 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:11.034551    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 12:12:11.038953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.034559    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 12:12:11.038953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.035424    2575 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 12:12:11.043239 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.043223    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 12:12:11.044267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.044254    2575 server.go:1019] "Starting client certificate rotation"
May 25 12:12:11.044366 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.044350    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 12:12:11.044405 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.044388    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 12:12:11.073983 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.073961    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 12:12:11.076627 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.076607    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 12:12:11.096470 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.096455    2575 log.go:25] "Validated CRI v1 runtime API"
May 25 12:12:11.102534 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.102519    2575 log.go:25] "Validated CRI v1 image API"
May 25 12:12:11.103864 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.103852    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 12:12:11.106685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.106668    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 12:12:11.108061 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.108044    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b27449c6-0c8a-4467-9d70-cc5bdb3a4dc4:/dev/nvme0n1p3 dec3975f-1a73-461d-8d37-42411c15a144:/dev/nvme0n1p4]
May 25 12:12:11.108104 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.108062    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 12:12:11.112263 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.112146    2575 manager.go:217] Machine: {Timestamp:2026-05-25 12:12:11.111680163 +0000 UTC m=+0.456941007 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099840 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec224f9e7d7f4a227a22e6d23ada7a69 SystemUUID:ec224f9e-7d7f-4a22-7a22-e6d23ada7a69 BootID:41ff809b-9b2a-4c43-9ac5-dd0753e422fd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:a2:8c:3d:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:a2:8c:3d:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:d0:80:26:b6:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 12:12:11.112983 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.112972    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 12:12:11.113091 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.113080    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 12:12:11.116583 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.116560    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 12:12:11.116722 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.116586    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 12:12:11.116767 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.116732    2575 topology_manager.go:138] "Creating topology manager with none policy"
May 25 12:12:11.116767 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.116740    2575 container_manager_linux.go:306] "Creating device plugin manager"
May 25 12:12:11.116767 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.116747    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 12:12:11.117682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.117672    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 12:12:11.118925 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.118915    2575 state_mem.go:36] "Initialized new in-memory state store"
May 25 12:12:11.119024 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.119016    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 12:12:11.121730 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.121721    2575 kubelet.go:491] "Attempting to sync node with API server"
May 25 12:12:11.121769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.121735    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 12:12:11.121769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.121747    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 12:12:11.121769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.121756    2575 kubelet.go:397] "Adding apiserver pod source"
May 25 12:12:11.121769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.121764    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 12:12:11.122631 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.122612    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hckcm"
May 25 12:12:11.122903 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.122891    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 12:12:11.122963 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.122910    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 12:12:11.126186 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.126172    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 12:12:11.128627 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.128612    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 12:12:11.129741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.129726    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hckcm"
May 25 12:12:11.130171 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130158    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130179    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130185    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130191    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130215    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130224    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130230    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130237    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130247    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 12:12:11.130285 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130280    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 12:12:11.130657 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130307    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 12:12:11.130657 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.130317    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 12:12:11.131283 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.131272    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 12:12:11.131330 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.131285    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 12:12:11.135709 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.134536    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 12:12:11.135873 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.134541    2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 12:12:11.135931 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.135872    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 12:12:11.137225 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.137189    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 12:12:11.137320 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.137256    2575 server.go:1295] "Started kubelet"
May 25 12:12:11.137417 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.137367    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 12:12:11.137517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.137446    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 12:12:11.137517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.137381    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 12:12:11.137976 ip-10-0-130-54 systemd[1]: Started Kubernetes Kubelet.
May 25 12:12:11.139063 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.139037    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 12:12:11.140379 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.140365    2575 server.go:317] "Adding debug handlers to kubelet server"
May 25 12:12:11.146435 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.146418    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 12:12:11.147376 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.147355    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 12:12:11.148048 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148030    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 12:12:11.148189 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148173    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 12:12:11.148189 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148188    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 12:12:11.148344 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148224    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 12:12:11.148344 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148302    2575 reconstruct.go:97] "Volume reconstruction finished"
May 25 12:12:11.148344 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148315    2575 reconciler.go:26] "Reconciler: start to sync state"
May 25 12:12:11.148843 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148828    2575 factory.go:55] Registering systemd factory
May 25 12:12:11.148901 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.148847    2575 factory.go:223] Registration of the systemd container factory successfully
May 25 12:12:11.149087 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.149067    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.149149 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149100    2575 factory.go:153] Registering CRI-O factory
May 25 12:12:11.149149 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149111    2575 factory.go:223] Registration of the crio container factory successfully
May 25 12:12:11.149245 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149152    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 12:12:11.149245 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149169    2575 factory.go:103] Registering Raw factory
May 25 12:12:11.149245 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149183    2575 manager.go:1196] Started watching for new ooms in manager
May 25 12:12:11.149580 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.149567    2575 manager.go:319] Starting recovery of all containers
May 25 12:12:11.153550 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.153529    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:11.156237 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.156214    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-54.ec2.internal\" not found" node="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.156325 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.156306    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 12:12:11.159618 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.159603    2575 manager.go:324] Recovery completed
May 25 12:12:11.160914 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.160892    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 25 12:12:11.164863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.164850    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.166693 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.166680    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.166752 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.166706    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.166752 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.166718    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.168333 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.168316    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 12:12:11.168400 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.168333    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 12:12:11.168400 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.168353    2575 state_mem.go:36] "Initialized new in-memory state store"
May 25 12:12:11.172382 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.172368    2575 policy_none.go:49] "None policy: Start"
May 25 12:12:11.172439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.172385    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 12:12:11.172439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.172395    2575 state_mem.go:35] "Initializing new in-memory state store"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211501    2575 manager.go:341] "Starting Device Plugin manager"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.211526    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211535    2575 server.go:85] "Starting device plugin registration server"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211764    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211776    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211889    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211960    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.211969    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.212584    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.212630    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.215398    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.215415    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.215430    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.215439    2575 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.215491    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 12:12:11.230751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.217545    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:11.312369 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.312325    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.313106 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.313091    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.313162 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.313120    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.313162 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.313131    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.313162 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.313151    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.316960 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.316943    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"]
May 25 12:12:11.317009 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.316998    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.318402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.318387    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.318461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.318413    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.318461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.318424    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.320691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.320678    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.320880 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.320864    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.320918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.320902    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.321293 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321281    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.321341 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321304    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.321341 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321314    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.321416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321365    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.321416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321387    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.321416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321393    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.321416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.321401    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.321416 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.321408    2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-54.ec2.internal\": node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.323618 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.323605    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.323665 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.323630    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 12:12:11.324276 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.324262    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory"
May 25 12:12:11.324340 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.324287    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure"
May 25 12:12:11.324340 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.324296    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID"
May 25 12:12:11.337745 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.337728    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.348838 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.348818    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-54.ec2.internal\" not found" node="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.349523 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.349498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.349622 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.349524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.349622 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.349542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bda6a02b4c92a0b4e2cb4f871b9cfb7a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"bda6a02b4c92a0b4e2cb4f871b9cfb7a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.353068 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.353054    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-54.ec2.internal\" not found" node="ip-10-0-130-54.ec2.internal"
May 25 12:12:11.438214 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.438176    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.450094 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450072    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bda6a02b4c92a0b4e2cb4f871b9cfb7a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"bda6a02b4c92a0b4e2cb4f871b9cfb7a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.450094 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450095    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.450275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450112    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.450275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450148    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.450275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450177    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bda6a02b4c92a0b4e2cb4f871b9cfb7a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"bda6a02b4c92a0b4e2cb4f871b9cfb7a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.450275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.450188    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2571864243eb7979d131f57fba2ec6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"e2571864243eb7979d131f57fba2ec6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.538943 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.538918    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.639677 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.639600    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.653019 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.653001    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.655956 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.655868    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:11.740244 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.740221    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.840636 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.840617    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.941145 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:11.941080    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found"
May 25 12:12:11.950967 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:11.950945    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:12.043552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.043533    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 12:12:12.044071 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.043652    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 12:12:12.044071 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.043696    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 12:12:12.044071 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.043711    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 12:12:12.048676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.048658    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal"
May 25 12:12:12.066956 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.066925    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 12:12:12.069992 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.069973    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"
May 25 12:12:12.078023 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.078001    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 12:12:12.122297 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.122168    2575 apiserver.go:52] "Watching apiserver"
May 25 12:12:12.129148 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.129131    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 12:12:12.129470 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.129450    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal","openshift-multus/multus-tvl7s","openshift-ovn-kubernetes/ovnkube-node-ztrgm","kube-system/konnectivity-agent-nh6sf","kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hs4bg","openshift-dns/node-resolver-h9ftx","openshift-multus/multus-additional-cni-plugins-nngk4","openshift-multus/network-metrics-daemon-8rl5f","openshift-network-diagnostics/network-check-target-8pjfw","openshift-network-operator/iptables-alerter-j5vc2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6","openshift-image-registry/node-ca-jbkkn"]
May 25 12:12:12.132412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.132387    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 12:07:11 +0000 UTC" deadline="2027-11-16 00:14:09.212479927 +0000 UTC"
May 25 12:12:12.132412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.132409    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12948h1m57.080072658s"
May 25 12:12:12.133521 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.133509    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.133619 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.133603    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.135258 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135232    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 12:12:12.135350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135234    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 12:12:12.135350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135275    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 12:12:12.135350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135235    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 12:12:12.135552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135378    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5jf5\""
May 25 12:12:12.135552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135517    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 12:12:12.135552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135534    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h59kd\""
May 25 12:12:12.135749 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.135733    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 12:12:12.136371 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.136354    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.138413 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.138221    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 12:12:12.138760 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.138741    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 12:12:12.138828 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.138808    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q2bfp\""
May 25 12:12:12.139123 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.139028    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 12:12:12.139291 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.139274    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 12:12:12.139478 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.139358    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.139547 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.139526    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 12:12:12.140144 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.140123    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 12:12:12.141411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.141396    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 12:12:12.141547 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.141532    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.141590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.141570    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 12:12:12.141713 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.141693    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xn6j\""
May 25 12:12:12.142864 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.142847    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrknx\""
May 25 12:12:12.143068 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.143053    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 12:12:12.143145 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.143104    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 12:12:12.144301 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.144287    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.145634 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.145621    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n4j85\""
May 25 12:12:12.145847 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.145836    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 12:12:12.145883 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.145837    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 12:12:12.146475 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.146463    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.146544 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.146524    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:12.148407 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.148392    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 12:12:12.148681 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.148665    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:12.148767 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.148749    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:12.150811 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.150789    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.152488 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.152174    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 12:12:12.152488 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.152295    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rgz9x\""
May 25 12:12:12.152488 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.152425    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 12:12:12.152488 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.152436    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 12:12:12.153026 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153008    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.153092 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-sys\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.153092 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cnibin\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.153185 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153185 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-daemon-config\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153185 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kmk\" (UniqueName: \"kubernetes.io/projected/ec72fddb-42e6-4e20-a256-ec9698f33035-kube-api-access-d7kmk\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-kubelet\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-conf-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec72fddb-42e6-4e20-a256-ec9698f33035-hosts-file\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-etc-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-multus-certs\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.153360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-config\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-var-lib-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-run\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88e4d693-faf7-49f7-b034-008cb33581c6-agent-certs\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-k8s-cni-cncf-io\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-env-overrides\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88e4d693-faf7-49f7-b034-008cb33581c6-konnectivity-ca\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-hostroot\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-etc-kubernetes\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-node-log\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.153673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-modprobe-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysconfig\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-cnibin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-log-socket\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-netd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-var-lib-kubelet\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-tuned\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-cni-binary-copy\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-conf\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.153982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-os-release\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-socket-dir-parent\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-systemd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovn-node-metrics-cert\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-kubernetes\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.154248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4tns\" (UniqueName: \"kubernetes.io/projected/d5494f26-2f09-4c5d-b8f1-d3c5779af603-kube-api-access-l4tns\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54m6g\" (UniqueName: \"kubernetes.io/projected/5727767b-83e6-4d1d-86eb-9eaa30653a27-kube-api-access-54m6g\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-system-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-netns\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec72fddb-42e6-4e20-a256-ec9698f33035-tmp-dir\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-lib-modules\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-script-lib\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154447    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-systemd\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l99wp\" (UniqueName: \"kubernetes.io/projected/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-kube-api-access-l99wp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-kubelet\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-netns\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-tmp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-os-release\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.154994 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlds7\" (UniqueName: \"kubernetes.io/projected/4b9a351f-dbad-450b-af37-58ec64475ee2-kube-api-access-rlds7\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-host\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xs6\" (UniqueName: \"kubernetes.io/projected/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-kube-api-access-z8xs6\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-bin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-ovn\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-bin\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-multus\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-systemd-units\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.154888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-slash\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.155113    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.155113    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sx822\""
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.155152    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 12:12:12.155807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.155415    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.156607 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.156590    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 12:12:12.156757 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.156741    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 12:12:12.156820 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.156767    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n9rz2\""
May 25 12:12:12.156869 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.156822    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 12:12:12.160673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.160653    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 12:12:12.178835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.178817    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxdx9"
May 25 12:12:12.193263 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.193217    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxdx9"
May 25 12:12:12.200361 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.200334    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda6a02b4c92a0b4e2cb4f871b9cfb7a.slice/crio-35bcbaa3e4301030a7c43ef803b4350acb86bc6218e2425bb6076e9593668dff WatchSource:0}: Error finding container 35bcbaa3e4301030a7c43ef803b4350acb86bc6218e2425bb6076e9593668dff: Status 404 returned error can't find the container with id 35bcbaa3e4301030a7c43ef803b4350acb86bc6218e2425bb6076e9593668dff
May 25 12:12:12.200550 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.200533    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2571864243eb7979d131f57fba2ec6d.slice/crio-d58bf0d57b4827d63bf62c05dd544453c46a50e7c0c3f9fe94ec424b15101129 WatchSource:0}: Error finding container d58bf0d57b4827d63bf62c05dd544453c46a50e7c0c3f9fe94ec424b15101129: Status 404 returned error can't find the container with id d58bf0d57b4827d63bf62c05dd544453c46a50e7c0c3f9fe94ec424b15101129
May 25 12:12:12.204500 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.204488    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:12:12.217955 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.217926    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"e2571864243eb7979d131f57fba2ec6d","Type":"ContainerStarted","Data":"d58bf0d57b4827d63bf62c05dd544453c46a50e7c0c3f9fe94ec424b15101129"}
May 25 12:12:12.218951 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.218929    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" event={"ID":"bda6a02b4c92a0b4e2cb4f871b9cfb7a","Type":"ContainerStarted","Data":"35bcbaa3e4301030a7c43ef803b4350acb86bc6218e2425bb6076e9593668dff"}
May 25 12:12:12.248955 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.248939    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 12:12:12.255600 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255583    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l99wp\" (UniqueName: \"kubernetes.io/projected/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-kube-api-access-l99wp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.255685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255607    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-kubelet\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.255685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255623    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-netns\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.255685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255640    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-tmp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.255685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255656    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-os-release\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.255850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255679    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlds7\" (UniqueName: \"kubernetes.io/projected/4b9a351f-dbad-450b-af37-58ec64475ee2-kube-api-access-rlds7\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.255850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-netns\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.255850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-kubelet\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.255850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255796    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-host\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.255850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-os-release\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255852    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xs6\" (UniqueName: \"kubernetes.io/projected/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-kube-api-access-z8xs6\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-bin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255892    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-host\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255908    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-ovn\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255933    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-bin\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255943    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-bin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255958    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255977    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-multus\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255970    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.255995    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-ovn\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr959\" (UniqueName: \"kubernetes.io/projected/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-kube-api-access-qr959\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256039    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-bin\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5zkr\" (UniqueName: \"kubernetes.io/projected/54641cd2-7412-42a4-abd8-0acfaddd8886-kube-api-access-x5zkr\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.256077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-host\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-cni-multus\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256096    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-systemd-units\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256122    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-slash\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256141    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-sys\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-systemd-units\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256160    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cnibin\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256194    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256214    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cnibin\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256216    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-slash\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256230    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-daemon-config\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256230    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-sys\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256258    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kmk\" (UniqueName: \"kubernetes.io/projected/ec72fddb-42e6-4e20-a256-ec9698f33035-kube-api-access-d7kmk\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-sys-fs\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256300    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256324    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-kubelet\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256343    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-conf-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.256741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256363    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec72fddb-42e6-4e20-a256-ec9698f33035-hosts-file\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256390    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-etc-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-conf-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-var-lib-kubelet\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256417    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-socket-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256448    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec72fddb-42e6-4e20-a256-ec9698f33035-hosts-file\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-device-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256488    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256495    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-multus-certs\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256520    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-etc-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256558    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-config\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-host-slash\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.256601    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrbf\" (UniqueName: \"kubernetes.io/projected/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-kube-api-access-ffrbf\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256540    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-multus-certs\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.257590 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.256700    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:12.756638064 +0000 UTC m=+2.101898895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256722    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-var-lib-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-run\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-daemon-config\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256778    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88e4d693-faf7-49f7-b034-008cb33581c6-agent-certs\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256784    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-var-lib-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256805    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256843    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-run\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256925    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256928    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256937    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-k8s-cni-cncf-io\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.256984    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-env-overrides\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257010    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88e4d693-faf7-49f7-b034-008cb33581c6-konnectivity-ca\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-hostroot\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257054    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-k8s-cni-cncf-io\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257062    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-etc-kubernetes\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-config\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257087    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-node-log\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.258402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257117    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257125    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-hostroot\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257128    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-etc-kubernetes\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257152    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-node-log\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257179    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-modprobe-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257219    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysconfig\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257252    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257282    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-cnibin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257285    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-modprobe-d\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysconfig\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257320    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-log-socket\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257345    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-env-overrides\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257365    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-netd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-cnibin\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257392    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-var-lib-kubelet\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257400    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-log-socket\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257418    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-tuned\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-host-cni-netd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257444    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-cni-binary-copy\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-var-lib-kubelet\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257558    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-conf\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257598    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88e4d693-faf7-49f7-b034-008cb33581c6-konnectivity-ca\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257609    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-os-release\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257637    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-socket-dir-parent\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257658    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-systemd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257695    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovn-node-metrics-cert\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257709    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-sysctl-conf\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257720    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-kubernetes\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-multus-socket-dir-parent\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257765    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257822    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257824    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-os-release\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.259838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257847    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a351f-dbad-450b-af37-58ec64475ee2-cni-binary-copy\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257854    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4tns\" (UniqueName: \"kubernetes.io/projected/d5494f26-2f09-4c5d-b8f1-d3c5779af603-kube-api-access-l4tns\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257884    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54m6g\" (UniqueName: \"kubernetes.io/projected/5727767b-83e6-4d1d-86eb-9eaa30653a27-kube-api-access-54m6g\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-registration-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-serviceca\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257968    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257989    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.257995    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-system-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258030    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-netns\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258055    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec72fddb-42e6-4e20-a256-ec9698f33035-tmp-dir\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258080    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258105    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-lib-modules\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258151    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-script-lib\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258184    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-lib-modules\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-iptables-alerter-script\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258257    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-host-run-netns\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258260    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-openvswitch\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258294    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-systemd\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258308    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a351f-dbad-450b-af37-58ec64475ee2-system-cni-dir\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258349    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258363    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5727767b-83e6-4d1d-86eb-9eaa30653a27-run-systemd\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258405    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-kubernetes\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-systemd\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec72fddb-42e6-4e20-a256-ec9698f33035-tmp-dir\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.258882    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovnkube-script-lib\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.259598    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-tmp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.259951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5727767b-83e6-4d1d-86eb-9eaa30653a27-ovn-node-metrics-cert\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.259992    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88e4d693-faf7-49f7-b034-008cb33581c6-agent-certs\") pod \"konnectivity-agent-nh6sf\" (UID: \"88e4d693-faf7-49f7-b034-008cb33581c6\") " pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.260835 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.260712    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-etc-tuned\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.264540 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.264523    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:12.264601 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.264545    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:12.264601 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.264565    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:12.264674 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.264622    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:12.764605648 +0000 UTC m=+2.109866496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:12.266593 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.266565    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kmk\" (UniqueName: \"kubernetes.io/projected/ec72fddb-42e6-4e20-a256-ec9698f33035-kube-api-access-d7kmk\") pod \"node-resolver-h9ftx\" (UID: \"ec72fddb-42e6-4e20-a256-ec9698f33035\") " pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.266937 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.266913    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xs6\" (UniqueName: \"kubernetes.io/projected/a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9-kube-api-access-z8xs6\") pod \"multus-additional-cni-plugins-nngk4\" (UID: \"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9\") " pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.267158 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.267143    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l99wp\" (UniqueName: \"kubernetes.io/projected/e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6-kube-api-access-l99wp\") pod \"tuned-hs4bg\" (UID: \"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6\") " pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.267516 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.267496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlds7\" (UniqueName: \"kubernetes.io/projected/4b9a351f-dbad-450b-af37-58ec64475ee2-kube-api-access-rlds7\") pod \"multus-tvl7s\" (UID: \"4b9a351f-dbad-450b-af37-58ec64475ee2\") " pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.267796 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.267778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54m6g\" (UniqueName: \"kubernetes.io/projected/5727767b-83e6-4d1d-86eb-9eaa30653a27-kube-api-access-54m6g\") pod \"ovnkube-node-ztrgm\" (UID: \"5727767b-83e6-4d1d-86eb-9eaa30653a27\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.268389 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.268374    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4tns\" (UniqueName: \"kubernetes.io/projected/d5494f26-2f09-4c5d-b8f1-d3c5779af603-kube-api-access-l4tns\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.359143 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359119    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-iptables-alerter-script\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.359234 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359158    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr959\" (UniqueName: \"kubernetes.io/projected/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-kube-api-access-qr959\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.359234 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359174    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359234 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359190    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5zkr\" (UniqueName: \"kubernetes.io/projected/54641cd2-7412-42a4-abd8-0acfaddd8886-kube-api-access-x5zkr\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359234 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359216    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-host\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359240    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-sys-fs\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359266    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-socket-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359271    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-host\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359292    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-device-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359325    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-host-slash\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359336    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-sys-fs\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359348    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrbf\" (UniqueName: \"kubernetes.io/projected/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-kube-api-access-ffrbf\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359378    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359390    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-device-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359416    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-registration-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359440    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-serviceca\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-socket-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-registration-dir\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-host-slash\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54641cd2-7412-42a4-abd8-0acfaddd8886-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359640    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-iptables-alerter-script\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.359932 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.359862    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-serviceca\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.366870 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.366848    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr959\" (UniqueName: \"kubernetes.io/projected/bffdccb1-6aa4-4e70-b962-7da8fe2da1b9-kube-api-access-qr959\") pod \"iptables-alerter-j5vc2\" (UID: \"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9\") " pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.366951 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.366913    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrbf\" (UniqueName: \"kubernetes.io/projected/b4077fd2-1ca5-4df0-8bec-ea87fd64832d-kube-api-access-ffrbf\") pod \"node-ca-jbkkn\" (UID: \"b4077fd2-1ca5-4df0-8bec-ea87fd64832d\") " pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.367651 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.367635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5zkr\" (UniqueName: \"kubernetes.io/projected/54641cd2-7412-42a4-abd8-0acfaddd8886-kube-api-access-x5zkr\") pod \"aws-ebs-csi-driver-node-d6ns6\" (UID: \"54641cd2-7412-42a4-abd8-0acfaddd8886\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.462753 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.462656    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9ftx"
May 25 12:12:12.468264 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.468249    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvl7s"
May 25 12:12:12.470658 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.470637    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec72fddb_42e6_4e20_a256_ec9698f33035.slice/crio-be476a4caaf0827735173f9942aaebb263456c10762da3f0e89d6efe0c16e786 WatchSource:0}: Error finding container be476a4caaf0827735173f9942aaebb263456c10762da3f0e89d6efe0c16e786: Status 404 returned error can't find the container with id be476a4caaf0827735173f9942aaebb263456c10762da3f0e89d6efe0c16e786
May 25 12:12:12.475433 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.475411    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a351f_dbad_450b_af37_58ec64475ee2.slice/crio-e28e9494bcbdb2bdbb68d9f9df3bd5277b55040aafaf0c829d47076e46ecd837 WatchSource:0}: Error finding container e28e9494bcbdb2bdbb68d9f9df3bd5277b55040aafaf0c829d47076e46ecd837: Status 404 returned error can't find the container with id e28e9494bcbdb2bdbb68d9f9df3bd5277b55040aafaf0c829d47076e46ecd837
May 25 12:12:12.508186 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.508165    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:12.513701 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.513678    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:12.514425 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.514405    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5727767b_83e6_4d1d_86eb_9eaa30653a27.slice/crio-58ddca75cac079d6557dab2d80aafb7134fbb4efb95f17cada267494d32fd957 WatchSource:0}: Error finding container 58ddca75cac079d6557dab2d80aafb7134fbb4efb95f17cada267494d32fd957: Status 404 returned error can't find the container with id 58ddca75cac079d6557dab2d80aafb7134fbb4efb95f17cada267494d32fd957
May 25 12:12:12.518531 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.518515    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hs4bg"
May 25 12:12:12.518820 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.518799    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e4d693_faf7_49f7_b034_008cb33581c6.slice/crio-56367791f90d582a130167a730b0825e6986442175e20cd2e7b2c9d0c49cd8b6 WatchSource:0}: Error finding container 56367791f90d582a130167a730b0825e6986442175e20cd2e7b2c9d0c49cd8b6: Status 404 returned error can't find the container with id 56367791f90d582a130167a730b0825e6986442175e20cd2e7b2c9d0c49cd8b6
May 25 12:12:12.524572 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.524550    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nngk4"
May 25 12:12:12.524849 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.524829    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38f73cd_5ca6_44ce_bbe2_2a7cd39549e6.slice/crio-1695b31753953d65ce04b652f3f0be066ce5f8a409e24bd8bd837abbaf949388 WatchSource:0}: Error finding container 1695b31753953d65ce04b652f3f0be066ce5f8a409e24bd8bd837abbaf949388: Status 404 returned error can't find the container with id 1695b31753953d65ce04b652f3f0be066ce5f8a409e24bd8bd837abbaf949388
May 25 12:12:12.530150 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.530127    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5vc2"
May 25 12:12:12.535534 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.535515    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6"
May 25 12:12:12.537814 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.537788    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffdccb1_6aa4_4e70_b962_7da8fe2da1b9.slice/crio-5bd934684f538c0cd5fe846975103fd4996a07742884ee7ea64caa61d3d3e4cc WatchSource:0}: Error finding container 5bd934684f538c0cd5fe846975103fd4996a07742884ee7ea64caa61d3d3e4cc: Status 404 returned error can't find the container with id 5bd934684f538c0cd5fe846975103fd4996a07742884ee7ea64caa61d3d3e4cc
May 25 12:12:12.541814 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.541793    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbkkn"
May 25 12:12:12.544131 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.544108    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54641cd2_7412_42a4_abd8_0acfaddd8886.slice/crio-ec2a7b4a8403bbb1638a09e70892844421e671f5b12c8508fadad0cf81eab1f0 WatchSource:0}: Error finding container ec2a7b4a8403bbb1638a09e70892844421e671f5b12c8508fadad0cf81eab1f0: Status 404 returned error can't find the container with id ec2a7b4a8403bbb1638a09e70892844421e671f5b12c8508fadad0cf81eab1f0
May 25 12:12:12.550697 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:12.550675    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4077fd2_1ca5_4df0_8bec_ea87fd64832d.slice/crio-1f113828676f5887fd9ac62530a975c7033e774f4dac62091bacae9c69633842 WatchSource:0}: Error finding container 1f113828676f5887fd9ac62530a975c7033e774f4dac62091bacae9c69633842: Status 404 returned error can't find the container with id 1f113828676f5887fd9ac62530a975c7033e774f4dac62091bacae9c69633842
May 25 12:12:12.674863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.674836    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:12.762412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.762345    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:12.762579 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.762533    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:12.762641 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.762606    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:13.762584026 +0000 UTC m=+3.107844861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:12.863446 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:12.863420    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:12.863583 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.863550    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:12.863583 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.863567    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:12.863583 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.863578    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:12.863741 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:12.863637    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:13.863618967 +0000 UTC m=+3.208879804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:13.194784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.194699    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:07:12 +0000 UTC" deadline="2028-01-13 23:34:01.707576906 +0000 UTC"
May 25 12:12:13.194784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.194732    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14363h21m48.51284795s"
May 25 12:12:13.228747 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.228699    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nh6sf" event={"ID":"88e4d693-faf7-49f7-b034-008cb33581c6","Type":"ContainerStarted","Data":"56367791f90d582a130167a730b0825e6986442175e20cd2e7b2c9d0c49cd8b6"}
May 25 12:12:13.233918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.233864    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"58ddca75cac079d6557dab2d80aafb7134fbb4efb95f17cada267494d32fd957"}
May 25 12:12:13.241574 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.241515    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvl7s" event={"ID":"4b9a351f-dbad-450b-af37-58ec64475ee2","Type":"ContainerStarted","Data":"e28e9494bcbdb2bdbb68d9f9df3bd5277b55040aafaf0c829d47076e46ecd837"}
May 25 12:12:13.248359 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.248312    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9ftx" event={"ID":"ec72fddb-42e6-4e20-a256-ec9698f33035","Type":"ContainerStarted","Data":"be476a4caaf0827735173f9942aaebb263456c10762da3f0e89d6efe0c16e786"}
May 25 12:12:13.250695 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.250637    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbkkn" event={"ID":"b4077fd2-1ca5-4df0-8bec-ea87fd64832d","Type":"ContainerStarted","Data":"1f113828676f5887fd9ac62530a975c7033e774f4dac62091bacae9c69633842"}
May 25 12:12:13.253489 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.253454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6" event={"ID":"54641cd2-7412-42a4-abd8-0acfaddd8886","Type":"ContainerStarted","Data":"ec2a7b4a8403bbb1638a09e70892844421e671f5b12c8508fadad0cf81eab1f0"}
May 25 12:12:13.259588 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.259562    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hs4bg" event={"ID":"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6","Type":"ContainerStarted","Data":"1695b31753953d65ce04b652f3f0be066ce5f8a409e24bd8bd837abbaf949388"}
May 25 12:12:13.265761 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.265731    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5vc2" event={"ID":"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9","Type":"ContainerStarted","Data":"5bd934684f538c0cd5fe846975103fd4996a07742884ee7ea64caa61d3d3e4cc"}
May 25 12:12:13.271178 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.271141    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerStarted","Data":"186f51750aec9af0691d7b496a1724d1dbc9475640c396d13c71561c2f74b075"}
May 25 12:12:13.404455 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.404426    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:13.499860 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.499790    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:13.769248 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.769153    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:13.769403 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.769338    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:13.769403 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.769402    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:15.769383159 +0000 UTC m=+5.114643994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:13.870254 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:13.870221    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:13.870416 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.870399    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:13.870482 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.870419    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:13.870482 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.870435    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:13.870580 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:13.870494    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:15.870476239 +0000 UTC m=+5.215737073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:14.195648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.195568    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:07:12 +0000 UTC" deadline="2027-12-16 19:06:59.259956193 +0000 UTC"
May 25 12:12:14.195648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.195608    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13686h54m45.064351529s"
May 25 12:12:14.216097 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.215968    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:14.222275 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:14.216580    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:14.222275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.215968    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:14.222275 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:14.218781    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:14.272541 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.272358    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 12:12:14.810374 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.810342    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-46ctg"]
May 25 12:12:14.813326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.813305    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.813458 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:14.813379    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:14.877827 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.877800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-kubelet-config\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.877968 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.877868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-dbus\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.877968 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.877945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.979024 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.978988    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-kubelet-config\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.979188 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.979067    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-dbus\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.979188 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.979116    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.979326 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:14.979249    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:14.979326 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:14.979311    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:15.479292329 +0000 UTC m=+4.824553164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:14.979617 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.979567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-kubelet-config\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:14.979740 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:14.979639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d906ac4-0b05-447c-bd3a-8165bbb061ec-dbus\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:15.486900 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:15.486865    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:15.487379 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.487002    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:15.487379 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.487072    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:16.487053604 +0000 UTC m=+5.832314438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:15.788766 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:15.788691    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:15.788925 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.788854    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:15.788925 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.788910    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:19.788892513 +0000 UTC m=+9.134153345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:15.889910 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:15.889716    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:15.890083 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.889919    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:15.890083 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.889938    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:15.890083 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.889951    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:15.890083 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:15.890008    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:19.889990851 +0000 UTC m=+9.235251686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:16.215943 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:16.215873    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:16.216100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:16.215872    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:16.216100 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:16.216004    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:16.216100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:16.215878    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:16.216279 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:16.216111    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:16.216279 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:16.216176    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:16.495335 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:16.495260    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:16.495750 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:16.495390    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:16.495750 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:16.495452    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:18.495433737 +0000 UTC m=+7.840694573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:18.215741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:18.215708    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:18.216169 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:18.215826    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:18.216169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:18.215854    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:18.216169 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:18.215972    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:18.216169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:18.216018    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:18.216169 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:18.216085    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:18.509040 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:18.508465    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:18.509040 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:18.508623    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:18.509040 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:18.508681    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:22.508664383 +0000 UTC m=+11.853925221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:19.817502 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:19.817466    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:19.817971 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.817628    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:19.817971 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.817704    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:27.817682416 +0000 UTC m=+17.162943252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:19.918630 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:19.918507    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:19.918818 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.918682    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:19.918818 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.918708    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:19.918818 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.918721    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:19.918818 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:19.918778    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:27.918759437 +0000 UTC m=+17.264020275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:20.216074 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:20.216040    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:20.216267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:20.216043    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:20.216267 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:20.216175    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:20.216267 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:20.216219    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:20.216267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:20.216064    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:20.216481 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:20.216306    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:22.216447 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:22.216409    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:22.216956 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:22.216479    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:22.216956 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:22.216577    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:22.216956 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:22.216585    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:22.216956 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:22.216674    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:22.216956 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:22.216749    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:22.540785 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:22.540708    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:22.540943 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:22.540849    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:22.540943 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:22.540902    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:30.540888797 +0000 UTC m=+19.886149631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:24.216608 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:24.216576    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:24.217055 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:24.216586    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:24.217055 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:24.216683    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:24.217055 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:24.216697    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:24.217055 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:24.216802    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:24.217055 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:24.216895    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:26.215737 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:26.215687    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:26.215737 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:26.215721    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:26.216158 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:26.215757    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:26.216158 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:26.215840    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:26.216158 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:26.215959    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:26.216158 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:26.216052    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:27.883840 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:27.883805    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:27.884282 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.883959    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:27.884282 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.884020    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:43.88400195 +0000 UTC m=+33.229262787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:27.984407 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:27.984373    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:27.984580 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.984549    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:27.984580 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.984575    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:27.984669 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.984587    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:27.984669 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:27.984637    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:43.984621962 +0000 UTC m=+33.329882793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:28.216613 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:28.216533    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:28.216613 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:28.216585    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:28.216613 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:28.216586    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:28.216855 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:28.216679    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:28.216855 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:28.216730    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:28.216855 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:28.216824    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:30.216156 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:30.216120    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:30.216596 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:30.216120    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:30.216596 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:30.216262    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:30.216596 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:30.216120    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:30.216596 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:30.216340    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:30.216596 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:30.216389    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:30.602805 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:30.602782    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:30.602935 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:30.602877    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 12:12:30.602935 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:30.602922    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret podName:8d906ac4-0b05-447c-bd3a-8165bbb061ec nodeName:}" failed. No retries permitted until 2026-05-25 12:12:46.602910043 +0000 UTC m=+35.948170875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret") pod "global-pull-secret-syncer-46ctg" (UID: "8d906ac4-0b05-447c-bd3a-8165bbb061ec") : object "kube-system"/"original-pull-secret" not registered
May 25 12:12:31.301516 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:31.301375    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hs4bg" event={"ID":"e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6","Type":"ContainerStarted","Data":"6168ca9a3001aa608dad6f9569d1f03b979d614a7da1ac7102a1e4fcb1e490cd"}
May 25 12:12:31.302776 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:31.302752    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" event={"ID":"bda6a02b4c92a0b4e2cb4f871b9cfb7a","Type":"ContainerStarted","Data":"ef201f9c5baa0a385211c151b4b5bea8215d11e62624ad18256aa66c083aaaa0"}
May 25 12:12:31.316820 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:31.316784    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hs4bg" podStartSLOduration=1.843500293 podStartE2EDuration="20.316772768s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.526577136 +0000 UTC m=+1.871837967" lastFinishedPulling="2026-05-25 12:12:30.999849606 +0000 UTC m=+20.345110442" observedRunningTime="2026-05-25 12:12:31.316524872 +0000 UTC m=+20.661785725" watchObservedRunningTime="2026-05-25 12:12:31.316772768 +0000 UTC m=+20.662033621"
May 25 12:12:31.329876 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:31.329844    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" podStartSLOduration=19.32983231 podStartE2EDuration="19.32983231s" podCreationTimestamp="2026-05-25 12:12:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:12:31.329207657 +0000 UTC m=+20.674468503" watchObservedRunningTime="2026-05-25 12:12:31.32983231 +0000 UTC m=+20.675093163"
May 25 12:12:32.216594 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.216383    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:32.216742 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.216383    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:32.216742 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:32.216651    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:32.216742 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.216385    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:32.216742 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:32.216733    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:32.216939 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:32.216830    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:32.306040 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.306009    2575 generic.go:358] "Generic (PLEG): container finished" podID="e2571864243eb7979d131f57fba2ec6d" containerID="0de9712163c33fabd1c063fb1b10768bbcb0ba254b7a07b71d614d9327eb4d7f" exitCode=0
May 25 12:12:32.306757 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.306094    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"e2571864243eb7979d131f57fba2ec6d","Type":"ContainerDied","Data":"0de9712163c33fabd1c063fb1b10768bbcb0ba254b7a07b71d614d9327eb4d7f"}
May 25 12:12:32.307627 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.307600    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbkkn" event={"ID":"b4077fd2-1ca5-4df0-8bec-ea87fd64832d","Type":"ContainerStarted","Data":"bae3025d8c07a95047941f4bdfedaa9106a2a9df51b456b7298fc8dd111bff00"}
May 25 12:12:32.309061 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.309037    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6" event={"ID":"54641cd2-7412-42a4-abd8-0acfaddd8886","Type":"ContainerStarted","Data":"a523d8714422bc41114c1df8d5828628b229ce4363255bbeee1d3cec6bb85124"}
May 25 12:12:32.310542 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.310515    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="2c444415eb7d3edc59b86b222d211a4818ff55b747904409b4734c64a7baeb17" exitCode=0
May 25 12:12:32.310668 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.310573    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"2c444415eb7d3edc59b86b222d211a4818ff55b747904409b4734c64a7baeb17"}
May 25 12:12:32.311985 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.311961    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nh6sf" event={"ID":"88e4d693-faf7-49f7-b034-008cb33581c6","Type":"ContainerStarted","Data":"459f5ba628bb1b3c4ec1ab0a426616cfc316fb5b2a81650cc0974332aa938a53"}
May 25 12:12:32.314779 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.314762    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:12:32.315137 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315107    2575 generic.go:358] "Generic (PLEG): container finished" podID="5727767b-83e6-4d1d-86eb-9eaa30653a27" containerID="c37480292f2b6b0bed5ce618aa6694b0f96bb0b6539e3cd2655b44632ecd57f8" exitCode=1
May 25 12:12:32.315232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315133    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"4f0a590647ef5b5e67f54c362d1ab00b7d33416e8bb93c05b51ac5e659f10ecd"}
May 25 12:12:32.315232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315156    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"ad48457940dcc1a80d9e2af21540765a03f1b5148f507aa753fa3eaff3638796"}
May 25 12:12:32.315232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315170    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"43aac8bc0afd9583644084bd84b3c3e3b020a942a8b20e61121a1c013cb67950"}
May 25 12:12:32.315232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315187    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"5edffde693fcae89310df42015a146c71f9d3c4eb3e3b989f360c0bce033385c"}
May 25 12:12:32.315232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315225    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerDied","Data":"c37480292f2b6b0bed5ce618aa6694b0f96bb0b6539e3cd2655b44632ecd57f8"}
May 25 12:12:32.315416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.315240    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"8b75b41fde5d66064bef89a5d3d198ec14672e4e2e029d8f841c2c4ec583db04"}
May 25 12:12:32.316618 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.316586    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvl7s" event={"ID":"4b9a351f-dbad-450b-af37-58ec64475ee2","Type":"ContainerStarted","Data":"8fc10b77f0af8e19a7155b9c8b15be2599fb11a3d35c9d7af445f983b4bb45c0"}
May 25 12:12:32.317967 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.317913    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9ftx" event={"ID":"ec72fddb-42e6-4e20-a256-ec9698f33035","Type":"ContainerStarted","Data":"35fe94f8e8a20ccbd9747ae35c9470ca80943f9527000b45b4f906c85be70daf"}
May 25 12:12:32.337076 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.337037    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h9ftx" podStartSLOduration=3.084061751 podStartE2EDuration="21.337024218s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.472519948 +0000 UTC m=+1.817780783" lastFinishedPulling="2026-05-25 12:12:30.725482418 +0000 UTC m=+20.070743250" observedRunningTime="2026-05-25 12:12:32.336549688 +0000 UTC m=+21.681810540" watchObservedRunningTime="2026-05-25 12:12:32.337024218 +0000 UTC m=+21.682285071"
May 25 12:12:32.355632 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.355593    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nh6sf" podStartSLOduration=2.875359143 podStartE2EDuration="21.355584446s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.520094425 +0000 UTC m=+1.865355256" lastFinishedPulling="2026-05-25 12:12:31.00031971 +0000 UTC m=+20.345580559" observedRunningTime="2026-05-25 12:12:32.355211502 +0000 UTC m=+21.700472356" watchObservedRunningTime="2026-05-25 12:12:32.355584446 +0000 UTC m=+21.700845300"
May 25 12:12:32.390459 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.390425    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tvl7s" podStartSLOduration=2.458707405 podStartE2EDuration="21.390413425s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.476888936 +0000 UTC m=+1.822149766" lastFinishedPulling="2026-05-25 12:12:31.408594948 +0000 UTC m=+20.753855786" observedRunningTime="2026-05-25 12:12:32.390298074 +0000 UTC m=+21.735558950" watchObservedRunningTime="2026-05-25 12:12:32.390413425 +0000 UTC m=+21.735674279"
May 25 12:12:32.402350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.402293    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jbkkn" podStartSLOduration=3.047852362 podStartE2EDuration="21.402283312s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.553441506 +0000 UTC m=+1.898702338" lastFinishedPulling="2026-05-25 12:12:30.907872445 +0000 UTC m=+20.253133288" observedRunningTime="2026-05-25 12:12:32.402016018 +0000 UTC m=+21.747276872" watchObservedRunningTime="2026-05-25 12:12:32.402283312 +0000 UTC m=+21.747544164"
May 25 12:12:32.876833 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:32.876609    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 12:12:33.221209 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.221115    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T12:12:32.876830141Z","UUID":"2cf50dac-7a67-4446-9f2c-e2620bde849b","Handler":null,"Name":"","Endpoint":""}
May 25 12:12:33.224086 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.224058    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 12:12:33.224086 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.224091    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 12:12:33.321289 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.321249    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5vc2" event={"ID":"bffdccb1-6aa4-4e70-b962-7da8fe2da1b9","Type":"ContainerStarted","Data":"a0dddc3e63277e3dff0b6b4b39cd504a117d3d06012b49117b5508d3f500765d"}
May 25 12:12:33.323026 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.323002    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"e2571864243eb7979d131f57fba2ec6d","Type":"ContainerStarted","Data":"ae5ddfef0c89c16944c61f9860dffc270f531888dd38869aa99c0d70835d9cf6"}
May 25 12:12:33.324825 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.324795    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6" event={"ID":"54641cd2-7412-42a4-abd8-0acfaddd8886","Type":"ContainerStarted","Data":"4e0b749ad56713ce2226b99038928427ab77607d4724980c67e7b622e02d418b"}
May 25 12:12:33.335564 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.335517    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j5vc2" podStartSLOduration=3.875605868 podStartE2EDuration="22.335502221s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.539937592 +0000 UTC m=+1.885198426" lastFinishedPulling="2026-05-25 12:12:30.999833944 +0000 UTC m=+20.345094779" observedRunningTime="2026-05-25 12:12:33.334615133 +0000 UTC m=+22.679875987" watchObservedRunningTime="2026-05-25 12:12:33.335502221 +0000 UTC m=+22.680763075"
May 25 12:12:33.347038 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:33.346979    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" podStartSLOduration=21.346966816 podStartE2EDuration="21.346966816s" podCreationTimestamp="2026-05-25 12:12:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:12:33.346588087 +0000 UTC m=+22.691848946" watchObservedRunningTime="2026-05-25 12:12:33.346966816 +0000 UTC m=+22.692227670"
May 25 12:12:34.216036 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.216011    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:34.216036 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.216028    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:34.216238 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.216048    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:34.216238 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:34.216121    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:34.216238 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:34.216187    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:34.216348 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:34.216292    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:34.328081 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.328053    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6" event={"ID":"54641cd2-7412-42a4-abd8-0acfaddd8886","Type":"ContainerStarted","Data":"bbb9e1a835fd209be3901fcb7a699b9ab9b1b7e86abb33a54106fb6ec03c2538"}
May 25 12:12:34.330552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.330534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:12:34.330873 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.330855    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"8f1413b1a76ef67490378e26964d622658a8417218912d4b6179271ff1856e8e"}
May 25 12:12:34.344222 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:34.344144    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6ns6" podStartSLOduration=2.204521999 podStartE2EDuration="23.344132103s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.546575793 +0000 UTC m=+1.891836629" lastFinishedPulling="2026-05-25 12:12:33.686185891 +0000 UTC m=+23.031446733" observedRunningTime="2026-05-25 12:12:34.343982681 +0000 UTC m=+23.689243544" watchObservedRunningTime="2026-05-25 12:12:34.344132103 +0000 UTC m=+23.689392956"
May 25 12:12:36.195280 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.195242    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:36.195989 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.195963    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:36.216516 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.216491    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:36.216631 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.216491    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:36.216631 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:36.216603    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:36.216748 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:36.216707    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:36.216748 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.216492    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:36.216849 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:36.216822    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:36.334262 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.334234    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:36.334705 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:36.334688    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nh6sf"
May 25 12:12:37.337580 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.337385    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerStarted","Data":"5d1dd3b09e5fc3ac689201f03606441bc23a0783abcdcef3842f21fdd04d8d80"}
May 25 12:12:37.340588 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.340569    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:12:37.341024 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.341001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"8bcd6cc92234b326cff53f6e4414637797a837d698182f5b6c22b5104afa74f3"}
May 25 12:12:37.341261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.341242    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:37.341261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.341265    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:37.341377 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.341279    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:37.341507 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.341479    2575 scope.go:117] "RemoveContainer" containerID="c37480292f2b6b0bed5ce618aa6694b0f96bb0b6539e3cd2655b44632ecd57f8"
May 25 12:12:37.357683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.357658    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:37.358382 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:37.358336    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:12:38.215766 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.215608    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:38.215897 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.215608    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:38.215897 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:38.215836    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:38.215993 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:38.215902    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:38.215993 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.215608    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:38.215993 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:38.215971    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:38.345168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.345128    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="5d1dd3b09e5fc3ac689201f03606441bc23a0783abcdcef3842f21fdd04d8d80" exitCode=0
May 25 12:12:38.345630 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.345287    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"5d1dd3b09e5fc3ac689201f03606441bc23a0783abcdcef3842f21fdd04d8d80"}
May 25 12:12:38.353105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.353074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:12:38.354747 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.354715    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" event={"ID":"5727767b-83e6-4d1d-86eb-9eaa30653a27","Type":"ContainerStarted","Data":"8df3f137a6e5bdec29c1542ddae5fbf5dbf7d06c622eb28fe0b3b3ffc9426a95"}
May 25 12:12:38.390036 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:38.389987    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm" podStartSLOduration=8.866931087 podStartE2EDuration="27.389971883s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.516144424 +0000 UTC m=+1.861405255" lastFinishedPulling="2026-05-25 12:12:31.039185215 +0000 UTC m=+20.384446051" observedRunningTime="2026-05-25 12:12:38.389498693 +0000 UTC m=+27.734759546" watchObservedRunningTime="2026-05-25 12:12:38.389971883 +0000 UTC m=+27.735232762"
May 25 12:12:39.023672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.023475    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46ctg"]
May 25 12:12:39.023672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.023597    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:39.023919 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:39.023711    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:39.024990 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.024903    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rl5f"]
May 25 12:12:39.025119 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.025011    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:39.025119 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.025088    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8pjfw"]
May 25 12:12:39.025237 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:39.025143    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:39.025237 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.025164    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:39.025363 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:39.025275    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:39.356808 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.356763    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="019f4ed0f5688710e0a7195af6502e7d9671a415c3ab798edc1eea6aacd3bef2" exitCode=0
May 25 12:12:39.357290 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:39.356831    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"019f4ed0f5688710e0a7195af6502e7d9671a415c3ab798edc1eea6aacd3bef2"}
May 25 12:12:40.216124 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:40.216098    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:40.216248 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:40.216212    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:40.361109 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:40.361076    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="24c72a1ccbfd3ccbd4fc52aec9a690422a4eab8641e6c2ec65f29ad8ccf008e0" exitCode=0
May 25 12:12:40.361437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:40.361151    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"24c72a1ccbfd3ccbd4fc52aec9a690422a4eab8641e6c2ec65f29ad8ccf008e0"}
May 25 12:12:41.216515 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:41.216478    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:41.216692 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:41.216581    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:41.216692 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:41.216640    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:41.216800 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:41.216752    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:42.216522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:42.216491    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:42.217074 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:42.216613    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:43.216169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:43.215992    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:43.216345 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:43.215992    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:43.216345 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:43.216265    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8pjfw" podUID="f85781fe-8eab-4a4f-b572-4d73e4ce4d58"
May 25 12:12:43.216345 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:43.216308    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46ctg" podUID="8d906ac4-0b05-447c-bd3a-8165bbb061ec"
May 25 12:12:43.902564 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:43.902532    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:43.903009 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:43.902649    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:43.903009 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:43.902709    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs podName:d5494f26-2f09-4c5d-b8f1-d3c5779af603 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:15.902690324 +0000 UTC m=+65.247951160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs") pod "network-metrics-daemon-8rl5f" (UID: "d5494f26-2f09-4c5d-b8f1-d3c5779af603") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 12:12:44.002862 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.002834    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:44.003051 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.003031    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 12:12:44.003102 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.003056    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 12:12:44.003102 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.003067    2575 projected.go:194] Error preparing data for projected volume kube-api-access-26vbb for pod openshift-network-diagnostics/network-check-target-8pjfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:44.003191 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.003126    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb podName:f85781fe-8eab-4a4f-b572-4d73e4ce4d58 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:16.003112247 +0000 UTC m=+65.348373082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-26vbb" (UniqueName: "kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb") pod "network-check-target-8pjfw" (UID: "f85781fe-8eab-4a4f-b572-4d73e4ce4d58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 12:12:44.215808 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.215719    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:44.216017 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.215840    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rl5f" podUID="d5494f26-2f09-4c5d-b8f1-d3c5779af603"
May 25 12:12:44.407833 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.407805    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeReady"
May 25 12:12:44.407968 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.407937    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 12:12:44.445018 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.444991    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:12:44.476521 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.476447    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-562sm"]
May 25 12:12:44.476648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.476602    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.478374 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.478354    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 12:12:44.478374 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.478366    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vptdj\""
May 25 12:12:44.478568 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.478420    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 12:12:44.478717 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.478702    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 12:12:44.484024 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.483966    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 12:12:44.490447 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.490428    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l2qct"]
May 25 12:12:44.490603 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.490569    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.492145 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.492112    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 12:12:44.492145 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.492138    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mckb4\""
May 25 12:12:44.492309 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.492144    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 12:12:44.511986 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.511959    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:12:44.512082 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.511993    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l2qct"]
May 25 12:12:44.512082 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.512008    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-562sm"]
May 25 12:12:44.512181 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.512129    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.514001 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.513763    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 12:12:44.514001 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.513809    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 12:12:44.514001 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.513838    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 12:12:44.514164 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.514105    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wgqbc\""
May 25 12:12:44.608388 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608525 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608525 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608525 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608525 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28dw6\" (UniqueName: \"kubernetes.io/projected/3f2fedc5-5e43-4030-9941-fee44a3fff85-kube-api-access-28dw6\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.608745 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.608745 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608745 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f2fedc5-5e43-4030-9941-fee44a3fff85-config-volume\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.608863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.608863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f69n5\" (UniqueName: \"kubernetes.io/projected/7547ff6a-aba2-47cf-a758-9c2acfe542c7-kube-api-access-f69n5\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.608978 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608978 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rlb\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.608978 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.608973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2fedc5-5e43-4030-9941-fee44a3fff85-tmp-dir\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.709894 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.709846    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f69n5\" (UniqueName: \"kubernetes.io/projected/7547ff6a-aba2-47cf-a758-9c2acfe542c7-kube-api-access-f69n5\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.710053 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.709928    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710053 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.709956    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rlb\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710053 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.709984    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2fedc5-5e43-4030-9941-fee44a3fff85-tmp-dir\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.710242 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710143    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710242 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710211    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710352 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710352 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710338    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2fedc5-5e43-4030-9941-fee44a3fff85-tmp-dir\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.710470 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710386    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710470 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710439    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28dw6\" (UniqueName: \"kubernetes.io/projected/3f2fedc5-5e43-4030-9941-fee44a3fff85-kube-api-access-28dw6\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.710572 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710473    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.710572 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710497    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710572 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710524    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f2fedc5-5e43-4030-9941-fee44a3fff85-config-volume\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.710572 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710800 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710585    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.710800 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710604    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.710800 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710722    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:12:44.710800 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710780    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:12:44.710800 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710792    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:45.210775142 +0000 UTC m=+34.556035995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:12:44.711093 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:45.210825203 +0000 UTC m=+34.556086035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:12:44.711093 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710726    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:12:44.711093 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710970    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:12:44.711093 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.710985    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.711093 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:44.710999    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:45.210990962 +0000 UTC m=+34.556251793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:12:44.711437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.711321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f2fedc5-5e43-4030-9941-fee44a3fff85-config-volume\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.711727 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.711685    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.715327 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.715304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.715463 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.715299    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.719265 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.719240    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:44.719534 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.719514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28dw6\" (UniqueName: \"kubernetes.io/projected/3f2fedc5-5e43-4030-9941-fee44a3fff85-kube-api-access-28dw6\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:44.719630 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.719556    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f69n5\" (UniqueName: \"kubernetes.io/projected/7547ff6a-aba2-47cf-a758-9c2acfe542c7-kube-api-access-f69n5\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:44.719690 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:44.719659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rlb\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:45.215436 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.215387    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:45.215436 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.215435    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.215472    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215535    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215564    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215586    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215619    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:46.2155986 +0000 UTC m=+35.560859434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:46.215637401 +0000 UTC m=+35.560898231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.215663    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215572    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:45.215735    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:46.215720969 +0000 UTC m=+35.560981807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:12:45.216014 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.215826    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:45.217777 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.217756    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 12:12:45.218012 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.217991    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 12:12:45.218083 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.218060    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 12:12:45.229414 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:45.229393    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7xdz\""
May 25 12:12:46.216377 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.216343    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:12:46.218217 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.218179    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 12:12:46.218352 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.218237    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvtsk\""
May 25 12:12:46.222900 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.222875    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:46.223047 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.222990    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:46.223047 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223032    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:12:46.223163 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.223059    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:46.223163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223099    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:48.223079666 +0000 UTC m=+37.568340516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:12:46.223163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223106    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:12:46.223163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223141    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:48.223130216 +0000 UTC m=+37.568391053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:12:46.223390 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223265    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:12:46.223390 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223307    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:12:46.223390 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:46.223356    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:48.223339074 +0000 UTC m=+37.568599923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:12:46.625237 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.625191    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:46.627434 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.627411    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d906ac4-0b05-447c-bd3a-8165bbb061ec-original-pull-secret\") pod \"global-pull-secret-syncer-46ctg\" (UID: \"8d906ac4-0b05-447c-bd3a-8165bbb061ec\") " pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:46.732758 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:46.732721    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46ctg"
May 25 12:12:47.006328 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:47.006149    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46ctg"]
May 25 12:12:47.010476 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:12:47.010448    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d906ac4_0b05_447c_bd3a_8165bbb061ec.slice/crio-0c8c53234df4b2539a8c07beb7d2cdb7915d24efe04e2e30c5b1adddf2f993c6 WatchSource:0}: Error finding container 0c8c53234df4b2539a8c07beb7d2cdb7915d24efe04e2e30c5b1adddf2f993c6: Status 404 returned error can't find the container with id 0c8c53234df4b2539a8c07beb7d2cdb7915d24efe04e2e30c5b1adddf2f993c6
May 25 12:12:47.375181 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:47.375148    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46ctg" event={"ID":"8d906ac4-0b05-447c-bd3a-8165bbb061ec","Type":"ContainerStarted","Data":"0c8c53234df4b2539a8c07beb7d2cdb7915d24efe04e2e30c5b1adddf2f993c6"}
May 25 12:12:47.377556 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:47.377525    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="0b0c055fcc312a76e93a4f01eae265e6d2dd5dc75e2c3ecc41399a74ab698b2b" exitCode=0
May 25 12:12:47.377693 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:47.377564    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"0b0c055fcc312a76e93a4f01eae265e6d2dd5dc75e2c3ecc41399a74ab698b2b"}
May 25 12:12:48.237853 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:48.237812    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:48.238023 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:48.237863    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:48.238023 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:48.237905    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:48.238023 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.237978    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238037    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238049    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:52.238029098 +0000 UTC m=+41.583289934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238057    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238051    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238090    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:52.238080899 +0000 UTC m=+41.583341735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:12:48.238189 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:48.238106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:52.238097662 +0000 UTC m=+41.583358499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:12:48.382574 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:48.382537    2575 generic.go:358] "Generic (PLEG): container finished" podID="a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9" containerID="b508f6308db8728ba17f61c1109ddd9935cfcae02d7ad89ea7854ad1266039f4" exitCode=0
May 25 12:12:48.383100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:48.382588    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerDied","Data":"b508f6308db8728ba17f61c1109ddd9935cfcae02d7ad89ea7854ad1266039f4"}
May 25 12:12:49.388519 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:49.388482    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nngk4" event={"ID":"a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9","Type":"ContainerStarted","Data":"7e9bfb00f17ccfd9b2b6afebbcb4e98215bedb6cec08f6ec7eb4e381c484037d"}
May 25 12:12:49.420593 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:49.420529    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nngk4" podStartSLOduration=4.077639893 podStartE2EDuration="38.420510153s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:12:12.533867478 +0000 UTC m=+1.879128314" lastFinishedPulling="2026-05-25 12:12:46.876737724 +0000 UTC m=+36.221998574" observedRunningTime="2026-05-25 12:12:49.420110894 +0000 UTC m=+38.765371748" watchObservedRunningTime="2026-05-25 12:12:49.420510153 +0000 UTC m=+38.765771021"
May 25 12:12:52.267971 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:52.267936    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:12:52.267971 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:52.267976    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:52.268003    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268087    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268104    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268152    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:00.268138716 +0000 UTC m=+49.613399561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268103    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268246    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:00.268234644 +0000 UTC m=+49.613495475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268105    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:12:52.268440 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:12:52.268280    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:00.268270687 +0000 UTC m=+49.613531517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:12:52.395886 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:52.395852    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46ctg" event={"ID":"8d906ac4-0b05-447c-bd3a-8165bbb061ec","Type":"ContainerStarted","Data":"8770cb736127594b124e21dabc0b3c4b3e0c81df8fe0f4bed1ed1b9f69ebeb72"}
May 25 12:12:52.409601 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:12:52.409564    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-46ctg" podStartSLOduration=33.683669548 podStartE2EDuration="38.409550947s" podCreationTimestamp="2026-05-25 12:12:14 +0000 UTC" firstStartedPulling="2026-05-25 12:12:47.012429196 +0000 UTC m=+36.357690026" lastFinishedPulling="2026-05-25 12:12:51.738310594 +0000 UTC m=+41.083571425" observedRunningTime="2026-05-25 12:12:52.409421605 +0000 UTC m=+41.754682461" watchObservedRunningTime="2026-05-25 12:12:52.409550947 +0000 UTC m=+41.754811792"
May 25 12:13:00.324496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:00.324452    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:13:00.324496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:00.324495    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:00.324528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324587    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324658    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324676    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-574b4949f8-xwf72: secret "image-registry-tls" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324677    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324660    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert podName:7547ff6a-aba2-47cf-a758-9c2acfe542c7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:16.324641178 +0000 UTC m=+65.669902009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert") pod "ingress-canary-l2qct" (UID: "7547ff6a-aba2-47cf-a758-9c2acfe542c7") : secret "canary-serving-cert" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324757    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls podName:3f2fedc5-5e43-4030-9941-fee44a3fff85 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:16.324743661 +0000 UTC m=+65.670004498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls") pod "dns-default-562sm" (UID: "3f2fedc5-5e43-4030-9941-fee44a3fff85") : secret "dns-default-metrics-tls" not found
May 25 12:13:00.324964 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:00.324768    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls podName:79fa6949-f9b0-4080-a066-cb832c04b1e0 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:16.324762574 +0000 UTC m=+65.670023406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls") pod "image-registry-574b4949f8-xwf72" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0") : secret "image-registry-tls" not found
May 25 12:13:03.358031 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:03.357996    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9ftx_ec72fddb-42e6-4e20-a256-ec9698f33035/dns-node-resolver/0.log"
May 25 12:13:04.150284 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:04.150250    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbkkn_b4077fd2-1ca5-4df0-8bec-ea87fd64832d/node-ca/0.log"
May 25 12:13:09.375656 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:09.375619    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztrgm"
May 25 12:13:15.940899 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:15.940861    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:13:15.942449 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:15.942424    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 12:13:15.954909 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:15.954882    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5494f26-2f09-4c5d-b8f1-d3c5779af603-metrics-certs\") pod \"network-metrics-daemon-8rl5f\" (UID: \"d5494f26-2f09-4c5d-b8f1-d3c5779af603\") " pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:13:16.041702 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.041676    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:13:16.043365 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.043347    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 12:13:16.054360 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.054339    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 12:13:16.065756 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.065735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vbb\" (UniqueName: \"kubernetes.io/projected/f85781fe-8eab-4a4f-b572-4d73e4ce4d58-kube-api-access-26vbb\") pod \"network-check-target-8pjfw\" (UID: \"f85781fe-8eab-4a4f-b572-4d73e4ce4d58\") " pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:13:16.128725 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.128695    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7xdz\""
May 25 12:13:16.137982 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.137960    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:13:16.228020 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.227998    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvtsk\""
May 25 12:13:16.236988 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.236967    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rl5f"
May 25 12:13:16.253004 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.252979    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8pjfw"]
May 25 12:13:16.256079 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:16.256055    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85781fe_8eab_4a4f_b572_4d73e4ce4d58.slice/crio-660cb2f057422a41bb8953f65c2d1d10a5d0e502c8557847fb347d8ee9815f12 WatchSource:0}: Error finding container 660cb2f057422a41bb8953f65c2d1d10a5d0e502c8557847fb347d8ee9815f12: Status 404 returned error can't find the container with id 660cb2f057422a41bb8953f65c2d1d10a5d0e502c8557847fb347d8ee9815f12
May 25 12:13:16.344442 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.344416    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:13:16.344584 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.344448    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:16.344584 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.344473    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:13:16.346610 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.346575    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7547ff6a-aba2-47cf-a758-9c2acfe542c7-cert\") pod \"ingress-canary-l2qct\" (UID: \"7547ff6a-aba2-47cf-a758-9c2acfe542c7\") " pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:13:16.346718 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.346693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"image-registry-574b4949f8-xwf72\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") " pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:16.346769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.346745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f2fedc5-5e43-4030-9941-fee44a3fff85-metrics-tls\") pod \"dns-default-562sm\" (UID: \"3f2fedc5-5e43-4030-9941-fee44a3fff85\") " pod="openshift-dns/dns-default-562sm"
May 25 12:13:16.354627 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.354607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rl5f"]
May 25 12:13:16.357210 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:16.357177    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5494f26_2f09_4c5d_b8f1_d3c5779af603.slice/crio-56367601c98dbd65ebbdfd74d7da4842e4bcabc25eb1cda7eb93fbb59bcad945 WatchSource:0}: Error finding container 56367601c98dbd65ebbdfd74d7da4842e4bcabc25eb1cda7eb93fbb59bcad945: Status 404 returned error can't find the container with id 56367601c98dbd65ebbdfd74d7da4842e4bcabc25eb1cda7eb93fbb59bcad945
May 25 12:13:16.444514 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.444482    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rl5f" event={"ID":"d5494f26-2f09-4c5d-b8f1-d3c5779af603","Type":"ContainerStarted","Data":"56367601c98dbd65ebbdfd74d7da4842e4bcabc25eb1cda7eb93fbb59bcad945"}
May 25 12:13:16.445450 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.445428    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8pjfw" event={"ID":"f85781fe-8eab-4a4f-b572-4d73e4ce4d58","Type":"ContainerStarted","Data":"660cb2f057422a41bb8953f65c2d1d10a5d0e502c8557847fb347d8ee9815f12"}
May 25 12:13:16.590595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.590569    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vptdj\""
May 25 12:13:16.599742 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.599723    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:16.602539 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.602521    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mckb4\""
May 25 12:13:16.611779 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.611754    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-562sm"
May 25 12:13:16.624493 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.624476    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wgqbc\""
May 25 12:13:16.633727 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.633703    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l2qct"
May 25 12:13:16.739529 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.739470    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:13:16.745158 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:16.745118    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fa6949_f9b0_4080_a066_cb832c04b1e0.slice/crio-3594270da1b6cf9507f22917e495b30841c29b30b62ad475a104019bd2d354a5 WatchSource:0}: Error finding container 3594270da1b6cf9507f22917e495b30841c29b30b62ad475a104019bd2d354a5: Status 404 returned error can't find the container with id 3594270da1b6cf9507f22917e495b30841c29b30b62ad475a104019bd2d354a5
May 25 12:13:16.754867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.754841    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-562sm"]
May 25 12:13:16.758176 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:16.758149    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2fedc5_5e43_4030_9941_fee44a3fff85.slice/crio-ff7e23f4fb540fe511f1c58667020268606b895b94fc4e10a6b9ce87f20e0a47 WatchSource:0}: Error finding container ff7e23f4fb540fe511f1c58667020268606b895b94fc4e10a6b9ce87f20e0a47: Status 404 returned error can't find the container with id ff7e23f4fb540fe511f1c58667020268606b895b94fc4e10a6b9ce87f20e0a47
May 25 12:13:16.772939 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:16.772915    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l2qct"]
May 25 12:13:16.777095 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:16.777072    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7547ff6a_aba2_47cf_a758_9c2acfe542c7.slice/crio-cdc0434899a37b66d1510290a1f85cfa5071b87fe3d815c62275bb535b370a07 WatchSource:0}: Error finding container cdc0434899a37b66d1510290a1f85cfa5071b87fe3d815c62275bb535b370a07: Status 404 returned error can't find the container with id cdc0434899a37b66d1510290a1f85cfa5071b87fe3d815c62275bb535b370a07
May 25 12:13:17.454260 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.454189    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" event={"ID":"79fa6949-f9b0-4080-a066-cb832c04b1e0","Type":"ContainerStarted","Data":"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"}
May 25 12:13:17.454260 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.454271    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" event={"ID":"79fa6949-f9b0-4080-a066-cb832c04b1e0","Type":"ContainerStarted","Data":"3594270da1b6cf9507f22917e495b30841c29b30b62ad475a104019bd2d354a5"}
May 25 12:13:17.455302 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.455128    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:17.458803 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.458774    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l2qct" event={"ID":"7547ff6a-aba2-47cf-a758-9c2acfe542c7","Type":"ContainerStarted","Data":"cdc0434899a37b66d1510290a1f85cfa5071b87fe3d815c62275bb535b370a07"}
May 25 12:13:17.461539 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.461513    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-562sm" event={"ID":"3f2fedc5-5e43-4030-9941-fee44a3fff85","Type":"ContainerStarted","Data":"ff7e23f4fb540fe511f1c58667020268606b895b94fc4e10a6b9ce87f20e0a47"}
May 25 12:13:17.477165 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:17.476919    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" podStartSLOduration=49.476902356 podStartE2EDuration="49.476902356s" podCreationTimestamp="2026-05-25 12:12:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:17.47592545 +0000 UTC m=+66.821186305" watchObservedRunningTime="2026-05-25 12:13:17.476902356 +0000 UTC m=+66.822163206"
May 25 12:13:20.470673 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.470637    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8pjfw" event={"ID":"f85781fe-8eab-4a4f-b572-4d73e4ce4d58","Type":"ContainerStarted","Data":"edbfb81be8be3a05dab764bd096aaee32af1d2a4069798f540a79a9d069524b2"}
May 25 12:13:20.471138 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.470731    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:13:20.472027 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.471997    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l2qct" event={"ID":"7547ff6a-aba2-47cf-a758-9c2acfe542c7","Type":"ContainerStarted","Data":"ef5adb45ba7f09355011049c07f2ff977108d588420ba7dcc81efa680659afce"}
May 25 12:13:20.473485 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.473465    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-562sm" event={"ID":"3f2fedc5-5e43-4030-9941-fee44a3fff85","Type":"ContainerStarted","Data":"2ed7fd5116ecfd3a13298d33e16657dee1b5ed5bd860f8b9e4b4af9f76dbd383"}
May 25 12:13:20.473568 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.473491    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-562sm" event={"ID":"3f2fedc5-5e43-4030-9941-fee44a3fff85","Type":"ContainerStarted","Data":"416d6dcc2047055e708bc3915ded05b424f3de67ad8c8e43c599a4aaab2e0e72"}
May 25 12:13:20.473609 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.473596    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-562sm"
May 25 12:13:20.475042 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.475021    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rl5f" event={"ID":"d5494f26-2f09-4c5d-b8f1-d3c5779af603","Type":"ContainerStarted","Data":"87a9a6f0fde8e44343d24a4e931573b4aebfa9ff5c934ca0daa752060dedc277"}
May 25 12:13:20.475138 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.475046    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rl5f" event={"ID":"d5494f26-2f09-4c5d-b8f1-d3c5779af603","Type":"ContainerStarted","Data":"e526a73b4d8712cffb436c17b1d822cccf1b0d1bc4bc758fcfd4df3a22a817be"}
May 25 12:13:20.486350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.486307    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8pjfw" podStartSLOduration=65.772681604 podStartE2EDuration="1m9.486296647s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:13:16.257816818 +0000 UTC m=+65.603077652" lastFinishedPulling="2026-05-25 12:13:19.97143185 +0000 UTC m=+69.316692695" observedRunningTime="2026-05-25 12:13:20.485642232 +0000 UTC m=+69.830903079" watchObservedRunningTime="2026-05-25 12:13:20.486296647 +0000 UTC m=+69.831557491"
May 25 12:13:20.501711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.501674    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-562sm" podStartSLOduration=33.301908113 podStartE2EDuration="36.50166409s" podCreationTimestamp="2026-05-25 12:12:44 +0000 UTC" firstStartedPulling="2026-05-25 12:13:16.759742863 +0000 UTC m=+66.105003697" lastFinishedPulling="2026-05-25 12:13:19.959498829 +0000 UTC m=+69.304759674" observedRunningTime="2026-05-25 12:13:20.500475167 +0000 UTC m=+69.845736019" watchObservedRunningTime="2026-05-25 12:13:20.50166409 +0000 UTC m=+69.846924943"
May 25 12:13:20.514068 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.514029    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l2qct" podStartSLOduration=33.331922462 podStartE2EDuration="36.514017096s" podCreationTimestamp="2026-05-25 12:12:44 +0000 UTC" firstStartedPulling="2026-05-25 12:13:16.778831422 +0000 UTC m=+66.124092253" lastFinishedPulling="2026-05-25 12:13:19.960926054 +0000 UTC m=+69.306186887" observedRunningTime="2026-05-25 12:13:20.513503434 +0000 UTC m=+69.858764288" watchObservedRunningTime="2026-05-25 12:13:20.514017096 +0000 UTC m=+69.859277950"
May 25 12:13:20.527721 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:20.527684    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8rl5f" podStartSLOduration=65.931491966 podStartE2EDuration="1m9.527673069s" podCreationTimestamp="2026-05-25 12:12:11 +0000 UTC" firstStartedPulling="2026-05-25 12:13:16.358882068 +0000 UTC m=+65.704142898" lastFinishedPulling="2026-05-25 12:13:19.955063167 +0000 UTC m=+69.300324001" observedRunningTime="2026-05-25 12:13:20.526741155 +0000 UTC m=+69.872002008" watchObservedRunningTime="2026-05-25 12:13:20.527673069 +0000 UTC m=+69.872933923"
May 25 12:13:25.726135 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.726099    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vxkv5"]
May 25 12:13:25.728586 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.728567    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.730539 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.730510    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 12:13:25.730680 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.730651    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 12:13:25.731068 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.731051    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 12:13:25.731168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.731100    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 12:13:25.731168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.731112    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wk9rc\""
May 25 12:13:25.742724 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.742702    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxkv5"]
May 25 12:13:25.755628 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.755608    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:13:25.801688 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.801663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.801765 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.801701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.801765 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.801728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-data-volume\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.801765 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.801745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtqlz\" (UniqueName: \"kubernetes.io/projected/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-api-access-wtqlz\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.801868 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.801808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-crio-socket\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.822938 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.822911    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-lbffj"]
May 25 12:13:25.824454 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.824438    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:25.826110 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.826094    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 12:13:25.826110 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.826110    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jqbm4\""
May 25 12:13:25.826276 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.826164    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 12:13:25.828923 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.828903    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:13:25.830311 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.830296    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"]
May 25 12:13:25.830452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.830435    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.831928 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.831912    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:25.832175 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832156    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 12:13:25.832339 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832252    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 12:13:25.832477 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832462    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 12:13:25.832549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832465    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 12:13:25.832549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832510    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 12:13:25.832656 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.832552    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l8gmm\""
May 25 12:13:25.834895 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.834874    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lbffj"]
May 25 12:13:25.835152 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.835132    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2l7ll\""
May 25 12:13:25.835291 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.835271    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 12:13:25.841374 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.841355    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"]
May 25 12:13:25.850664 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.850646    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:13:25.902459 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.902571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902467    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-crio-socket\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.902571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902517    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.902571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.902571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-crio-socket\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv9qh\" (UniqueName: \"kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902646    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-data-volume\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59h9\" (UniqueName: \"kubernetes.io/projected/c415d868-f9de-4ea2-b7a9-b0c4850a6a3c-kube-api-access-n59h9\") pod \"downloads-57bd96b888-lbffj\" (UID: \"c415d868-f9de-4ea2-b7a9-b0c4850a6a3c\") " pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.902784 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:25.903012 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8b43d69-6965-4377-93d4-a19b977ea53f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl\" (UID: \"d8b43d69-6965-4377-93d4-a19b977ea53f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:25.903012 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.902833    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtqlz\" (UniqueName: \"kubernetes.io/projected/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-api-access-wtqlz\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.903222 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.903186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-data-volume\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.903222 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.903191    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.903711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.903687    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.907191 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.907169    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:25.914746 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:25.914727    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtqlz\" (UniqueName: \"kubernetes.io/projected/beb76b6b-d6bb-45fe-ad40-a35edfc5697d-kube-api-access-wtqlz\") pod \"insights-runtime-extractor-vxkv5\" (UID: \"beb76b6b-d6bb-45fe-ad40-a35edfc5697d\") " pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:26.003804 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003754    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hv9qh\" (UniqueName: \"kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.003804 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003789    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.003940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003809    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n59h9\" (UniqueName: \"kubernetes.io/projected/c415d868-f9de-4ea2-b7a9-b0c4850a6a3c-kube-api-access-n59h9\") pod \"downloads-57bd96b888-lbffj\" (UID: \"c415d868-f9de-4ea2-b7a9-b0c4850a6a3c\") " pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:26.003940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003826    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.003940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003841    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.003940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.003864    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8b43d69-6965-4377-93d4-a19b977ea53f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl\" (UID: \"d8b43d69-6965-4377-93d4-a19b977ea53f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:26.004133 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.004006    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.004133 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.004045    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.004619 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.004600    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.004737 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.004717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.004775 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.004717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.006146 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.006126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.006630 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.006608    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.006701 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.006659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8b43d69-6965-4377-93d4-a19b977ea53f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl\" (UID: \"d8b43d69-6965-4377-93d4-a19b977ea53f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:26.012232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.012192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59h9\" (UniqueName: \"kubernetes.io/projected/c415d868-f9de-4ea2-b7a9-b0c4850a6a3c-kube-api-access-n59h9\") pod \"downloads-57bd96b888-lbffj\" (UID: \"c415d868-f9de-4ea2-b7a9-b0c4850a6a3c\") " pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:26.012322 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.012190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv9qh\" (UniqueName: \"kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh\") pod \"console-558f5c76b6-dfdtg\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") " pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.038097 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.038075    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxkv5"
May 25 12:13:26.134353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.134322    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:26.142072 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.142045    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:26.147707 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.147685    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:26.157899 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.157873    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxkv5"]
May 25 12:13:26.161130 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:26.161104    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb76b6b_d6bb_45fe_ad40_a35edfc5697d.slice/crio-4009981864deb50c6ee8a70b5292f15ccbf8cab0c88dbd86aa681fd747835481 WatchSource:0}: Error finding container 4009981864deb50c6ee8a70b5292f15ccbf8cab0c88dbd86aa681fd747835481: Status 404 returned error can't find the container with id 4009981864deb50c6ee8a70b5292f15ccbf8cab0c88dbd86aa681fd747835481
May 25 12:13:26.277716 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.277690    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lbffj"]
May 25 12:13:26.278547 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:26.278521    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc415d868_f9de_4ea2_b7a9_b0c4850a6a3c.slice/crio-4d6b8c119642f922ebdd3a62dced53b150a2d0e6739091f1af01509135832b67 WatchSource:0}: Error finding container 4d6b8c119642f922ebdd3a62dced53b150a2d0e6739091f1af01509135832b67: Status 404 returned error can't find the container with id 4d6b8c119642f922ebdd3a62dced53b150a2d0e6739091f1af01509135832b67
May 25 12:13:26.492919 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.492885    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lbffj" event={"ID":"c415d868-f9de-4ea2-b7a9-b0c4850a6a3c","Type":"ContainerStarted","Data":"4d6b8c119642f922ebdd3a62dced53b150a2d0e6739091f1af01509135832b67"}
May 25 12:13:26.494252 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.494228    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxkv5" event={"ID":"beb76b6b-d6bb-45fe-ad40-a35edfc5697d","Type":"ContainerStarted","Data":"4fb982d76daa1e4945e9a744465d33717c07adec76c1a83ffce6c51a042becb0"}
May 25 12:13:26.494375 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.494257    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxkv5" event={"ID":"beb76b6b-d6bb-45fe-ad40-a35edfc5697d","Type":"ContainerStarted","Data":"4009981864deb50c6ee8a70b5292f15ccbf8cab0c88dbd86aa681fd747835481"}
May 25 12:13:26.505740 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.505713    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:13:26.508273 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:26.508244    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"]
May 25 12:13:26.511056 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:26.511019    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb36f20_9dc6_4fba_8022_a1fcbce4bc6e.slice/crio-17f472f89b0348146d5b018f8af49c12d160426b2980c645a6dcebf1932eab33 WatchSource:0}: Error finding container 17f472f89b0348146d5b018f8af49c12d160426b2980c645a6dcebf1932eab33: Status 404 returned error can't find the container with id 17f472f89b0348146d5b018f8af49c12d160426b2980c645a6dcebf1932eab33
May 25 12:13:26.511799 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:26.511745    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b43d69_6965_4377_93d4_a19b977ea53f.slice/crio-137d1dc4b7236bb75b8daee94ed57017a579041aeefde251c8857ac5f6f0e85f WatchSource:0}: Error finding container 137d1dc4b7236bb75b8daee94ed57017a579041aeefde251c8857ac5f6f0e85f: Status 404 returned error can't find the container with id 137d1dc4b7236bb75b8daee94ed57017a579041aeefde251c8857ac5f6f0e85f
May 25 12:13:27.499416 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:27.499378    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl" event={"ID":"d8b43d69-6965-4377-93d4-a19b977ea53f","Type":"ContainerStarted","Data":"137d1dc4b7236bb75b8daee94ed57017a579041aeefde251c8857ac5f6f0e85f"}
May 25 12:13:27.500971 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:27.500943    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558f5c76b6-dfdtg" event={"ID":"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e","Type":"ContainerStarted","Data":"17f472f89b0348146d5b018f8af49c12d160426b2980c645a6dcebf1932eab33"}
May 25 12:13:27.503309 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:27.503275    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxkv5" event={"ID":"beb76b6b-d6bb-45fe-ad40-a35edfc5697d","Type":"ContainerStarted","Data":"43d63e03209dd6a059f463e448f8ce7712046173d938001fab1dc9197aec4d2a"}
May 25 12:13:28.507735 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.507693    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl" event={"ID":"d8b43d69-6965-4377-93d4-a19b977ea53f","Type":"ContainerStarted","Data":"16664354a1a89fea4e54baa2e23efde1310d21c7fc60c2796db385ea5cefc56e"}
May 25 12:13:28.508249 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.507914    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:28.510042 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.510001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxkv5" event={"ID":"beb76b6b-d6bb-45fe-ad40-a35edfc5697d","Type":"ContainerStarted","Data":"4806c46b091571273ba1fc126a53a3d6b6e88b9d1be4a413bf98d18b7791d7d1"}
May 25 12:13:28.513492 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.513469    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl"
May 25 12:13:28.522996 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.522949    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl" podStartSLOduration=2.427535656 podStartE2EDuration="3.522933082s" podCreationTimestamp="2026-05-25 12:13:25 +0000 UTC" firstStartedPulling="2026-05-25 12:13:26.513544807 +0000 UTC m=+75.858805638" lastFinishedPulling="2026-05-25 12:13:27.608942229 +0000 UTC m=+76.954203064" observedRunningTime="2026-05-25 12:13:28.522676845 +0000 UTC m=+77.867937710" watchObservedRunningTime="2026-05-25 12:13:28.522933082 +0000 UTC m=+77.868193936"
May 25 12:13:28.539236 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:28.539165    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vxkv5" podStartSLOduration=1.4674133710000001 podStartE2EDuration="3.539149466s" podCreationTimestamp="2026-05-25 12:13:25 +0000 UTC" firstStartedPulling="2026-05-25 12:13:26.23439637 +0000 UTC m=+75.579657218" lastFinishedPulling="2026-05-25 12:13:28.306132478 +0000 UTC m=+77.651393313" observedRunningTime="2026-05-25 12:13:28.538584452 +0000 UTC m=+77.883845305" watchObservedRunningTime="2026-05-25 12:13:28.539149466 +0000 UTC m=+77.884410320"
May 25 12:13:29.086809 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.086626    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"]
May 25 12:13:29.090011 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.089982    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.092760 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.092707    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-87z74\""
May 25 12:13:29.092928 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.092763    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 12:13:29.092928 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.092711    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 12:13:29.092928 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.092920    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 12:13:29.093137 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.093034    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 12:13:29.093137 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.093127    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 12:13:29.097148 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.097125    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"]
May 25 12:13:29.129408 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.129368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de2af86-03e9-463a-8f93-dc5221ddeed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.129545 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.129409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nq84\" (UniqueName: \"kubernetes.io/projected/3de2af86-03e9-463a-8f93-dc5221ddeed6-kube-api-access-7nq84\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.129545 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.129440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.129545 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.129465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.229926 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.229898    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de2af86-03e9-463a-8f93-dc5221ddeed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.230073 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.229935    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nq84\" (UniqueName: \"kubernetes.io/projected/3de2af86-03e9-463a-8f93-dc5221ddeed6-kube-api-access-7nq84\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.230073 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.229957    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.230211 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.230083    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.230610 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.230576    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de2af86-03e9-463a-8f93-dc5221ddeed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.232684 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.232659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.232815 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.232789    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3de2af86-03e9-463a-8f93-dc5221ddeed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.239465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.239438    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nq84\" (UniqueName: \"kubernetes.io/projected/3de2af86-03e9-463a-8f93-dc5221ddeed6-kube-api-access-7nq84\") pod \"prometheus-operator-7779bbdd78-twrgp\" (UID: \"3de2af86-03e9-463a-8f93-dc5221ddeed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.403604 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.403533    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"
May 25 12:13:29.550480 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:29.550453    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-twrgp"]
May 25 12:13:29.555417 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:29.555389    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de2af86_03e9_463a_8f93_dc5221ddeed6.slice/crio-f22afc816ef050f0e7f278e27ea0a70c3da6dc3c1dcc756742c311c48b4869c1 WatchSource:0}: Error finding container f22afc816ef050f0e7f278e27ea0a70c3da6dc3c1dcc756742c311c48b4869c1: Status 404 returned error can't find the container with id f22afc816ef050f0e7f278e27ea0a70c3da6dc3c1dcc756742c311c48b4869c1
May 25 12:13:30.480709 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:30.480675    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-562sm"
May 25 12:13:30.519620 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:30.519585    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp" event={"ID":"3de2af86-03e9-463a-8f93-dc5221ddeed6","Type":"ContainerStarted","Data":"f22afc816ef050f0e7f278e27ea0a70c3da6dc3c1dcc756742c311c48b4869c1"}
May 25 12:13:31.524350 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:31.524312    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558f5c76b6-dfdtg" event={"ID":"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e","Type":"ContainerStarted","Data":"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"}
May 25 12:13:31.540552 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:31.540464    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-558f5c76b6-dfdtg" podStartSLOduration=2.085493922 podStartE2EDuration="6.540446958s" podCreationTimestamp="2026-05-25 12:13:25 +0000 UTC" firstStartedPulling="2026-05-25 12:13:26.512944269 +0000 UTC m=+75.858205103" lastFinishedPulling="2026-05-25 12:13:30.967897308 +0000 UTC m=+80.313158139" observedRunningTime="2026-05-25 12:13:31.53932275 +0000 UTC m=+80.884583632" watchObservedRunningTime="2026-05-25 12:13:31.540446958 +0000 UTC m=+80.885707812"
May 25 12:13:32.528845 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:32.528805    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp" event={"ID":"3de2af86-03e9-463a-8f93-dc5221ddeed6","Type":"ContainerStarted","Data":"a94248ce5121aa11df0c176f55ab85970d8b145c16f6bf5b0fbb8e40aaf410f5"}
May 25 12:13:32.528845 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:32.528849    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp" event={"ID":"3de2af86-03e9-463a-8f93-dc5221ddeed6","Type":"ContainerStarted","Data":"ed320376dd2104d08b0137b86f186f677390a7a71adbc8580ceaa5d6987a42f6"}
May 25 12:13:32.550589 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:32.550533    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-twrgp" podStartSLOduration=1.295667204 podStartE2EDuration="3.550514829s" podCreationTimestamp="2026-05-25 12:13:29 +0000 UTC" firstStartedPulling="2026-05-25 12:13:29.556769905 +0000 UTC m=+78.902030736" lastFinishedPulling="2026-05-25 12:13:31.811617521 +0000 UTC m=+81.156878361" observedRunningTime="2026-05-25 12:13:32.549490699 +0000 UTC m=+81.894751553" watchObservedRunningTime="2026-05-25 12:13:32.550514829 +0000 UTC m=+81.895775683"
May 25 12:13:34.453858 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.453818    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"]
May 25 12:13:34.457420 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.457397    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.459180 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.459156    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 25 12:13:34.459371 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.459189    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v6lp9\""
May 25 12:13:34.459371 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.459190    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 25 12:13:34.466737 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.466695    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"]
May 25 12:13:34.491490 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.491453    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-grxph"]
May 25 12:13:34.494541 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.494525    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.496480 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.496462    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 12:13:34.496576 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.496487    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 12:13:34.496641 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.496572    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-htmsf\""
May 25 12:13:34.496758 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.496742    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 12:13:34.578761 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.578723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cb7x\" (UniqueName: \"kubernetes.io/projected/25796a72-fbc3-494d-9c68-cde37c09ff0e-kube-api-access-6cb7x\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.578761 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.578767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pz6f\" (UniqueName: \"kubernetes.io/projected/335d68e6-2b7e-4057-9d85-c249f17251f1-kube-api-access-4pz6f\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.578974 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.578797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.578974 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.578826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-metrics-client-ca\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.578974 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.578966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-textfile\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579135 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579135 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.579269 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579269 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-root\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579269 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-wtmp\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579421 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-sys\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.579421 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/335d68e6-2b7e-4057-9d85-c249f17251f1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.579421 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.579364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.680817 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680730    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cb7x\" (UniqueName: \"kubernetes.io/projected/25796a72-fbc3-494d-9c68-cde37c09ff0e-kube-api-access-6cb7x\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.680817 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680793    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pz6f\" (UniqueName: \"kubernetes.io/projected/335d68e6-2b7e-4057-9d85-c249f17251f1-kube-api-access-4pz6f\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680830    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680873    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-metrics-client-ca\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680901    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-textfile\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680927    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680957    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.680991    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681030    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-root\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681055    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-wtmp\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681096    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-sys\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681143    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/335d68e6-2b7e-4057-9d85-c249f17251f1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681176    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681342    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-wtmp\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681344    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-sys\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25796a72-fbc3-494d-9c68-cde37c09ff0e-root\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681544    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-textfile\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.681835 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:34.681782    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 25 12:13:34.681886 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:34.681838    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls podName:335d68e6-2b7e-4057-9d85-c249f17251f1 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:35.181818781 +0000 UTC m=+84.527079612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-vblcl" (UID: "335d68e6-2b7e-4057-9d85-c249f17251f1") : secret "openshift-state-metrics-tls" not found
May 25 12:13:34.681886 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:34.681841    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 12:13:34.681989 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:34.681897    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls podName:25796a72-fbc3-494d-9c68-cde37c09ff0e nodeName:}" failed. No retries permitted until 2026-05-25 12:13:35.181879792 +0000 UTC m=+84.527140623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls") pod "node-exporter-grxph" (UID: "25796a72-fbc3-494d-9c68-cde37c09ff0e") : secret "node-exporter-tls" not found
May 25 12:13:34.681989 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.681911    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.682091 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.682040    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25796a72-fbc3-494d-9c68-cde37c09ff0e-metrics-client-ca\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.682863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.682818    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/335d68e6-2b7e-4057-9d85-c249f17251f1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.685347 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.685263    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:34.686192 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.686164    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.690592 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.690572    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pz6f\" (UniqueName: \"kubernetes.io/projected/335d68e6-2b7e-4057-9d85-c249f17251f1-kube-api-access-4pz6f\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:34.690953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:34.690907    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cb7x\" (UniqueName: \"kubernetes.io/projected/25796a72-fbc3-494d-9c68-cde37c09ff0e-kube-api-access-6cb7x\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:35.185386 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.185353    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:35.185386 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.185394    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:35.187658 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.187627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25796a72-fbc3-494d-9c68-cde37c09ff0e-node-exporter-tls\") pod \"node-exporter-grxph\" (UID: \"25796a72-fbc3-494d-9c68-cde37c09ff0e\") " pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:35.187772 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.187746    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/335d68e6-2b7e-4057-9d85-c249f17251f1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vblcl\" (UID: \"335d68e6-2b7e-4057-9d85-c249f17251f1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:35.368477 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.368443    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"
May 25 12:13:35.402490 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.402453    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grxph"
May 25 12:13:35.417314 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:35.417279    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25796a72_fbc3_494d_9c68_cde37c09ff0e.slice/crio-4454148edebd99e9bc751e23b2f02b58eaea3625d8d2dee88d70d8b9bb3310fb WatchSource:0}: Error finding container 4454148edebd99e9bc751e23b2f02b58eaea3625d8d2dee88d70d8b9bb3310fb: Status 404 returned error can't find the container with id 4454148edebd99e9bc751e23b2f02b58eaea3625d8d2dee88d70d8b9bb3310fb
May 25 12:13:35.509451 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.509425    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vblcl"]
May 25 12:13:35.511942 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:35.511890    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335d68e6_2b7e_4057_9d85_c249f17251f1.slice/crio-fe0a306f708ebc7428496775f3074b12cc6fae54312c863734c0df8fe040787e WatchSource:0}: Error finding container fe0a306f708ebc7428496775f3074b12cc6fae54312c863734c0df8fe040787e: Status 404 returned error can't find the container with id fe0a306f708ebc7428496775f3074b12cc6fae54312c863734c0df8fe040787e
May 25 12:13:35.537075 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.537048    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl" event={"ID":"335d68e6-2b7e-4057-9d85-c249f17251f1","Type":"ContainerStarted","Data":"fe0a306f708ebc7428496775f3074b12cc6fae54312c863734c0df8fe040787e"}
May 25 12:13:35.537949 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.537929    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grxph" event={"ID":"25796a72-fbc3-494d-9c68-cde37c09ff0e","Type":"ContainerStarted","Data":"4454148edebd99e9bc751e23b2f02b58eaea3625d8d2dee88d70d8b9bb3310fb"}
May 25 12:13:35.545867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.545842    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:13:35.551264 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.551245    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.554267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.553235    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 12:13:35.554267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.553576    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 12:13:35.554267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.553776    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 12:13:35.554267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.553976    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 12:13:35.554267 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554135    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 12:13:35.554547 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554426    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 12:13:35.554547 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554445    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 12:13:35.554646 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554598    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 12:13:35.554703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554680    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 12:13:35.555000 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.554975    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-llc2z\""
May 25 12:13:35.560900 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.560880    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:13:35.688747 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.688890 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.688890 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.688995 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.688995 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689085 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.688998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689085 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqv9r\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689322 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689322 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.689322 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.689296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.762247 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.762162    2575 patch_prober.go:28] interesting pod/image-registry-574b4949f8-xwf72 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 25 12:13:35.762364 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.762233    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:13:35.789908 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.789861    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790045 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.789909    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790112 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790053    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790112 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790104    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790265 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790131    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqv9r\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790265 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790164    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790265 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790195    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790265 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790253    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790290    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790335    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790365    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790395    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790422    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790800 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.790775    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.790926 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:35.790906    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle podName:707c2144-c2e7-47d1-8a06-327036ca4674 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:36.290884597 +0000 UTC m=+85.636145446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674") : configmap references non-existent config key: ca-bundle.crt
May 25 12:13:35.791305 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.791125    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.796104 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.796062    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.796625 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.796585    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.798744    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.798912    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.799122    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.799311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799595 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.799555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.799870 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.799621    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.800358 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.800322    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:35.804061 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:35.804037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqv9r\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:36.143010 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.142974    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:36.143228 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.143025    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:36.148612 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.148577    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:36.295779 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.295744    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:36.296601 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.296571    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:36.471364 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.471325    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:13:36.544912 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.544843    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl" event={"ID":"335d68e6-2b7e-4057-9d85-c249f17251f1","Type":"ContainerStarted","Data":"52ada1d8816bf4ef0c9733c1bfd6ce62bb9cb30d1ee88614b369afa58a0755c7"}
May 25 12:13:36.544912 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.544887    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl" event={"ID":"335d68e6-2b7e-4057-9d85-c249f17251f1","Type":"ContainerStarted","Data":"693d1c5263529e375d745ffea53443395b55852bfd0bf6681d5feb006ce1013a"}
May 25 12:13:36.547435 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.547341    2575 generic.go:358] "Generic (PLEG): container finished" podID="25796a72-fbc3-494d-9c68-cde37c09ff0e" containerID="d203070bb2e17ce6f786940f0f7322d9d0ad1c04b4e850b8cec8e6fe42f97c1c" exitCode=0
May 25 12:13:36.547569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.547436    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grxph" event={"ID":"25796a72-fbc3-494d-9c68-cde37c09ff0e","Type":"ContainerDied","Data":"d203070bb2e17ce6f786940f0f7322d9d0ad1c04b4e850b8cec8e6fe42f97c1c"}
May 25 12:13:36.553429 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.553405    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:13:36.632927 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:36.632900    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:13:36.635648 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:36.635618    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707c2144_c2e7_47d1_8a06_327036ca4674.slice/crio-ce02b20614b24af3acc0c32f5f2cdf037fa1e0633786a77f1530a40080fb3a74 WatchSource:0}: Error finding container ce02b20614b24af3acc0c32f5f2cdf037fa1e0633786a77f1530a40080fb3a74: Status 404 returned error can't find the container with id ce02b20614b24af3acc0c32f5f2cdf037fa1e0633786a77f1530a40080fb3a74
May 25 12:13:37.445083 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.445047    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5695b7996-2ng9b"]
May 25 12:13:37.449073 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.449047    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451101    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451148    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sq4fk\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451166    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451257    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451359    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-33mng7r051qkp\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451366    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 25 12:13:37.451496 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.451407    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 25 12:13:37.462250 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.462227    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5695b7996-2ng9b"]
May 25 12:13:37.508988 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.508960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-grpc-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509137 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgj6h\" (UniqueName: \"kubernetes.io/projected/251a8dd7-24b2-40e8-b548-ca01759eae03-kube-api-access-cgj6h\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509137 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509292 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509292 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509292 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509431 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.509431 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.509337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251a8dd7-24b2-40e8-b548-ca01759eae03-metrics-client-ca\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.551357 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.551322    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"ce02b20614b24af3acc0c32f5f2cdf037fa1e0633786a77f1530a40080fb3a74"}
May 25 12:13:37.554413 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.554224    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl" event={"ID":"335d68e6-2b7e-4057-9d85-c249f17251f1","Type":"ContainerStarted","Data":"190b08b1c3eeaf0b372847288b2d64ed01a38409e632ea734e7dab196c656ea0"}
May 25 12:13:37.556462 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.556436    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grxph" event={"ID":"25796a72-fbc3-494d-9c68-cde37c09ff0e","Type":"ContainerStarted","Data":"cf98d12f497599c25040bcae0b86776ab349bcadcb6a3679173c40491d2a5b08"}
May 25 12:13:37.556575 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.556471    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grxph" event={"ID":"25796a72-fbc3-494d-9c68-cde37c09ff0e","Type":"ContainerStarted","Data":"5f7a62666334404eb54a18a7fd721088f6a83bfecbfc32fe7e9c69d7d943096f"}
May 25 12:13:37.571501 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.571444    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vblcl" podStartSLOduration=2.2453623990000002 podStartE2EDuration="3.571427655s" podCreationTimestamp="2026-05-25 12:13:34 +0000 UTC" firstStartedPulling="2026-05-25 12:13:35.648527504 +0000 UTC m=+84.993788338" lastFinishedPulling="2026-05-25 12:13:36.97459276 +0000 UTC m=+86.319853594" observedRunningTime="2026-05-25 12:13:37.569902833 +0000 UTC m=+86.915163687" watchObservedRunningTime="2026-05-25 12:13:37.571427655 +0000 UTC m=+86.916688511"
May 25 12:13:37.587420 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.587378    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-grxph" podStartSLOduration=2.696123386 podStartE2EDuration="3.58736768s" podCreationTimestamp="2026-05-25 12:13:34 +0000 UTC" firstStartedPulling="2026-05-25 12:13:35.420090165 +0000 UTC m=+84.765351010" lastFinishedPulling="2026-05-25 12:13:36.311334466 +0000 UTC m=+85.656595304" observedRunningTime="2026-05-25 12:13:37.585875049 +0000 UTC m=+86.931135915" watchObservedRunningTime="2026-05-25 12:13:37.58736768 +0000 UTC m=+86.932628534"
May 25 12:13:37.610674 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.610648    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.610828 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.610800    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.610945 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.610853    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.610945 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.610885    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.611066 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.610961    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.611066 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.611012    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251a8dd7-24b2-40e8-b548-ca01759eae03-metrics-client-ca\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.611230 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.611187    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-grpc-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.611336 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.611253    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgj6h\" (UniqueName: \"kubernetes.io/projected/251a8dd7-24b2-40e8-b548-ca01759eae03-kube-api-access-cgj6h\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.612229 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.612067    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251a8dd7-24b2-40e8-b548-ca01759eae03-metrics-client-ca\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.613807 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.613766    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.614779 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.614731    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.615377 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.615354    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.615891 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.615850    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.616183 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.616161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-grpc-tls\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.617556 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.617531    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251a8dd7-24b2-40e8-b548-ca01759eae03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.621266 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.621244    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgj6h\" (UniqueName: \"kubernetes.io/projected/251a8dd7-24b2-40e8-b548-ca01759eae03-kube-api-access-cgj6h\") pod \"thanos-querier-5695b7996-2ng9b\" (UID: \"251a8dd7-24b2-40e8-b548-ca01759eae03\") " pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.764161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.764055    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:37.931067 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:37.930992    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5695b7996-2ng9b"]
May 25 12:13:37.933895 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:37.933868    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251a8dd7_24b2_40e8_b548_ca01759eae03.slice/crio-8624f4a24648db5ad5781499ac0e8f344a5bbf70e2f655e19633d658d8cb40d3 WatchSource:0}: Error finding container 8624f4a24648db5ad5781499ac0e8f344a5bbf70e2f655e19633d658d8cb40d3: Status 404 returned error can't find the container with id 8624f4a24648db5ad5781499ac0e8f344a5bbf70e2f655e19633d658d8cb40d3
May 25 12:13:38.561313 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.561135    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983" exitCode=0
May 25 12:13:38.561313 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.561234    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983"}
May 25 12:13:38.563185 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.563102    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"8624f4a24648db5ad5781499ac0e8f344a5bbf70e2f655e19633d658d8cb40d3"}
May 25 12:13:38.768998 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.768958    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fd48fc8df-xhghg"]
May 25 12:13:38.772706 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.772678    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.774851 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.774824    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jlhkq\""
May 25 12:13:38.775215 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.775174    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3376l5c6q4h6i\""
May 25 12:13:38.775497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.775381    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 25 12:13:38.775497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.775390    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 25 12:13:38.775497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.775431    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 25 12:13:38.775497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.775457    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 12:13:38.779959 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.779681    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd48fc8df-xhghg"]
May 25 12:13:38.924297 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924297 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzb5\" (UniqueName: \"kubernetes.io/projected/f44afac3-4402-4e75-8c96-d73d71d81a4c-kube-api-access-dvzb5\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f44afac3-4402-4e75-8c96-d73d71d81a4c-audit-log\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-metrics-server-audit-profiles\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-client-certs\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-tls\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:38.924551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:38.924491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-client-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.025693 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.025852 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025706    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzb5\" (UniqueName: \"kubernetes.io/projected/f44afac3-4402-4e75-8c96-d73d71d81a4c-kube-api-access-dvzb5\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.025852 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025740    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f44afac3-4402-4e75-8c96-d73d71d81a4c-audit-log\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.025852 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025790    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-metrics-server-audit-profiles\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.025852 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025820    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-client-certs\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.026100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025880    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-tls\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.026100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.025913    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-client-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.026243 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.026219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f44afac3-4402-4e75-8c96-d73d71d81a4c-audit-log\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.026492 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.026462    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.027270 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.027232    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f44afac3-4402-4e75-8c96-d73d71d81a4c-metrics-server-audit-profiles\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.028838 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.028785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-client-ca-bundle\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.029168 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.029122    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-tls\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.029467 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.029428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f44afac3-4402-4e75-8c96-d73d71d81a4c-secret-metrics-server-client-certs\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.034779 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.034758    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzb5\" (UniqueName: \"kubernetes.io/projected/f44afac3-4402-4e75-8c96-d73d71d81a4c-kube-api-access-dvzb5\") pod \"metrics-server-6fd48fc8df-xhghg\" (UID: \"f44afac3-4402-4e75-8c96-d73d71d81a4c\") " pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.087797 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.087762    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:39.689328 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.689292    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"]
May 25 12:13:39.694261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.694232    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.696551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.696525    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 25 12:13:39.696678 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.696525    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 25 12:13:39.697213 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.697171    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 25 12:13:39.697611 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.697569    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vwhnn\""
May 25 12:13:39.697763 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.697654    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 25 12:13:39.697842 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.697816    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 25 12:13:39.704120 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.704079    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 25 12:13:39.708977 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.708956    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"]
May 25 12:13:39.834116 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834319 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-federate-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834319 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834183    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vtbm\" (UniqueName: \"kubernetes.io/projected/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-kube-api-access-8vtbm\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834319 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-metrics-client-ca\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834319 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834486 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-serving-certs-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834486 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.834576 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.834495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935581 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935541    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935768 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935591    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-federate-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935768 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935620    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vtbm\" (UniqueName: \"kubernetes.io/projected/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-kube-api-access-8vtbm\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935768 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935648    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-metrics-client-ca\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935768 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935688    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.935768 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935718    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-serving-certs-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.936012 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935778    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.936012 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.935822    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.936771 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.936733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-metrics-client-ca\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.936923 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.936827    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-serving-certs-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.936923 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.936910    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.938462 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.938415    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.938619 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.938597    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.938691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.938620    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-federate-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.939211 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.939175    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-telemeter-client-tls\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:39.944082 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:39.944028    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vtbm\" (UniqueName: \"kubernetes.io/projected/5c3b408b-e527-41dd-a3ac-aeb1be90ada1-kube-api-access-8vtbm\") pod \"telemeter-client-7c9dc7fc59-nx64x\" (UID: \"5c3b408b-e527-41dd-a3ac-aeb1be90ada1\") " pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:40.007432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:40.007399    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"
May 25 12:13:43.061304 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.061272    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:13:43.550969 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.550933    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:13:43.555709 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.555687    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.563143 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.563094    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 12:13:43.566726 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.566684    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:13:43.667527 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667839 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77glc\" (UniqueName: \"kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.667839 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.667780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768368 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768337    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768388    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768428    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768463    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768509    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768753 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.768753 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.768589    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77glc\" (UniqueName: \"kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.769537 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.769506    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.769537 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.769521    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.769735 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.769714    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.769899 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.769878    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.771432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.771407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.771432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.771419    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.776792 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.776769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77glc\" (UniqueName: \"kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc\") pod \"console-59cd848654-wc4hf\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") " pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:43.869998 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:43.869918    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:45.760483 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:45.760451    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:47.234053 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.234006    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x"]
May 25 12:13:47.236512 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:47.236476    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3b408b_e527_41dd_a3ac_aeb1be90ada1.slice/crio-97118c5b30bc01597b0ddd4abb28e16a9ef16b3b93395b4efb59928b79a47724 WatchSource:0}: Error finding container 97118c5b30bc01597b0ddd4abb28e16a9ef16b3b93395b4efb59928b79a47724: Status 404 returned error can't find the container with id 97118c5b30bc01597b0ddd4abb28e16a9ef16b3b93395b4efb59928b79a47724
May 25 12:13:47.466180 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.466134    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:13:47.468006 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.467963    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd48fc8df-xhghg"]
May 25 12:13:47.469268 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:47.469240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf31700_d393_4c6e_a650_a9301a33025f.slice/crio-03fe3be2a255b29a4437ec40a4feada77d91e3add01de332e9de43a73bd3c755 WatchSource:0}: Error finding container 03fe3be2a255b29a4437ec40a4feada77d91e3add01de332e9de43a73bd3c755: Status 404 returned error can't find the container with id 03fe3be2a255b29a4437ec40a4feada77d91e3add01de332e9de43a73bd3c755
May 25 12:13:47.471432 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:13:47.471397    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44afac3_4402_4e75_8c96_d73d71d81a4c.slice/crio-1b832eadf1a92636b4008931cc68461d7272b6f1b1dfa74ee0465b52e59d5c4c WatchSource:0}: Error finding container 1b832eadf1a92636b4008931cc68461d7272b6f1b1dfa74ee0465b52e59d5c4c: Status 404 returned error can't find the container with id 1b832eadf1a92636b4008931cc68461d7272b6f1b1dfa74ee0465b52e59d5c4c
May 25 12:13:47.598783 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.598665    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"f36d1ad9e0ba0bcac5a73e73b29ac35e9a07b0a96b6a58c8a3e085f4d9c07b90"}
May 25 12:13:47.598783 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.598717    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"e8cd8e3a0b2202e9c7bbad34ed3e81ef8150a7c97972e8b8824db80c09e4eeb2"}
May 25 12:13:47.598783 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.598754    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"4b58ea503c4fda93024abbb968e940e2e34a0d2dd4750c64fd70c90d3cb44981"}
May 25 12:13:47.599946 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.599917    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg" event={"ID":"f44afac3-4402-4e75-8c96-d73d71d81a4c","Type":"ContainerStarted","Data":"1b832eadf1a92636b4008931cc68461d7272b6f1b1dfa74ee0465b52e59d5c4c"}
May 25 12:13:47.603795 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.601572    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lbffj" event={"ID":"c415d868-f9de-4ea2-b7a9-b0c4850a6a3c","Type":"ContainerStarted","Data":"44f0ddb792bd76958eba48ab68e4b63b6c89468f1131729bf08fc30c6126a18b"}
May 25 12:13:47.603795 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.602724    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:47.604601 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.604037    2575 patch_prober.go:28] interesting pod/downloads-57bd96b888-lbffj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.10:8080/\": dial tcp 10.133.0.10:8080: connect: connection refused" start-of-body=
May 25 12:13:47.604601 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.604083    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-lbffj" podUID="c415d868-f9de-4ea2-b7a9-b0c4850a6a3c" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.10:8080/\": dial tcp 10.133.0.10:8080: connect: connection refused"
May 25 12:13:47.605279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.605231    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x" event={"ID":"5c3b408b-e527-41dd-a3ac-aeb1be90ada1","Type":"ContainerStarted","Data":"97118c5b30bc01597b0ddd4abb28e16a9ef16b3b93395b4efb59928b79a47724"}
May 25 12:13:47.607347 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.607165    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd848654-wc4hf" event={"ID":"2bf31700-d393-4c6e-a650-a9301a33025f","Type":"ContainerStarted","Data":"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"}
May 25 12:13:47.607347 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.607194    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd848654-wc4hf" event={"ID":"2bf31700-d393-4c6e-a650-a9301a33025f","Type":"ContainerStarted","Data":"03fe3be2a255b29a4437ec40a4feada77d91e3add01de332e9de43a73bd3c755"}
May 25 12:13:47.617764 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.617425    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-lbffj" podStartSLOduration=1.8278709869999998 podStartE2EDuration="22.617409941s" podCreationTimestamp="2026-05-25 12:13:25 +0000 UTC" firstStartedPulling="2026-05-25 12:13:26.281000438 +0000 UTC m=+75.626261270" lastFinishedPulling="2026-05-25 12:13:47.070539386 +0000 UTC m=+96.415800224" observedRunningTime="2026-05-25 12:13:47.616280843 +0000 UTC m=+96.961541709" watchObservedRunningTime="2026-05-25 12:13:47.617409941 +0000 UTC m=+96.962670795"
May 25 12:13:47.636186 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:47.634718    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59cd848654-wc4hf" podStartSLOduration=4.634702005 podStartE2EDuration="4.634702005s" podCreationTimestamp="2026-05-25 12:13:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:47.633979289 +0000 UTC m=+96.979240144" watchObservedRunningTime="2026-05-25 12:13:47.634702005 +0000 UTC m=+96.979962861"
May 25 12:13:48.621819 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:48.621786    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-lbffj"
May 25 12:13:50.774412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:50.774349    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerName="registry" containerID="cri-o://96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7" gracePeriod=30
May 25 12:13:51.073540 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.073306    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:51.241966 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.241930    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242081 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.241985    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242081 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242012    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242081 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242048    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242272 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242107    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242272 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242133    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242272 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242173    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.242272 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.242257    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rlb\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb\") pod \"79fa6949-f9b0-4080-a066-cb832c04b1e0\" (UID: \"79fa6949-f9b0-4080-a066-cb832c04b1e0\") "
May 25 12:13:51.245847 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.245006    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:13:51.247613 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.247578    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:13:51.249691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.247962    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:13:51.249691 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.248105    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:13:51.250936 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.250876    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:13:51.265501 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.265465    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb" (OuterVolumeSpecName: "kube-api-access-h2rlb") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "kube-api-access-h2rlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:13:51.265710 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.265682    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:13:51.274433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.273550    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "79fa6949-f9b0-4080-a066-cb832c04b1e0" (UID: "79fa6949-f9b0-4080-a066-cb832c04b1e0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:51.343253 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343194    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79fa6949-f9b0-4080-a066-cb832c04b1e0-ca-trust-extracted\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343253 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343241    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-installation-pull-secrets\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343261    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79fa6949-f9b0-4080-a066-cb832c04b1e0-image-registry-private-configuration\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343300    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-tls\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343311    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-bound-sa-token\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343320    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-trusted-ca\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343328    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79fa6949-f9b0-4080-a066-cb832c04b1e0-registry-certificates\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.343394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.343337    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rlb\" (UniqueName: \"kubernetes.io/projected/79fa6949-f9b0-4080-a066-cb832c04b1e0-kube-api-access-h2rlb\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:13:51.481013 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.480911    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8pjfw"
May 25 12:13:51.623974 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.623945    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x" event={"ID":"5c3b408b-e527-41dd-a3ac-aeb1be90ada1","Type":"ContainerStarted","Data":"1ce8ecba88352aa86f5c862735e8f5e5d8682670a535326a8402edc68cafabd2"}
May 25 12:13:51.624098 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.623986    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x" event={"ID":"5c3b408b-e527-41dd-a3ac-aeb1be90ada1","Type":"ContainerStarted","Data":"51136b4b7fe6c39d3f8688a1ff684d5a8d9c162e51b366498d66c0e78bad50df"}
May 25 12:13:51.624098 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.624001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x" event={"ID":"5c3b408b-e527-41dd-a3ac-aeb1be90ada1","Type":"ContainerStarted","Data":"f36eb1ad9522335229c2c4cdf8df565b8f8a7eca7cfac474e6794ddd9b8ba9c4"}
May 25 12:13:51.627166 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.627096    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"633c87d74a7fab5f0bbb3f4fd9c20f5a24b619235c547286c5ae8c24b1ad3d34"}
May 25 12:13:51.627166 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.627128    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"99f95ee039f2f5605f7506096654f2e30d579ed05b3552aa9bd1336d758c93e4"}
May 25 12:13:51.627166 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.627139    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" event={"ID":"251a8dd7-24b2-40e8-b548-ca01759eae03","Type":"ContainerStarted","Data":"1f9897518f810e0fe74c6c2cc01f3abd29072a461c5281ee5812e90af9def9da"}
May 25 12:13:51.628084 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.628048    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:51.629453 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.629422    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg" event={"ID":"f44afac3-4402-4e75-8c96-d73d71d81a4c","Type":"ContainerStarted","Data":"6131608c56eced6b99b7e524a78d2043f5c5b5e5e1698ce63354cc908bdead66"}
May 25 12:13:51.632733 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.632641    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"}
May 25 12:13:51.632733 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.632681    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"}
May 25 12:13:51.632733 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.632697    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"}
May 25 12:13:51.632733 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.632711    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"}
May 25 12:13:51.634241 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.633863    2575 generic.go:358] "Generic (PLEG): container finished" podID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerID="96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7" exitCode=0
May 25 12:13:51.634241 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.633926    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" event={"ID":"79fa6949-f9b0-4080-a066-cb832c04b1e0","Type":"ContainerDied","Data":"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"}
May 25 12:13:51.634241 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.633932    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574b4949f8-xwf72"
May 25 12:13:51.634241 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.633951    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574b4949f8-xwf72" event={"ID":"79fa6949-f9b0-4080-a066-cb832c04b1e0","Type":"ContainerDied","Data":"3594270da1b6cf9507f22917e495b30841c29b30b62ad475a104019bd2d354a5"}
May 25 12:13:51.634241 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.633973    2575 scope.go:117] "RemoveContainer" containerID="96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"
May 25 12:13:51.644176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.644044    2575 scope.go:117] "RemoveContainer" containerID="96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"
May 25 12:13:51.644376 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:13:51.644346    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7\": container with ID starting with 96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7 not found: ID does not exist" containerID="96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"
May 25 12:13:51.646515 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.644387    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7"} err="failed to get container status \"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7\": rpc error: code = NotFound desc = could not find container \"96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7\": container with ID starting with 96455d18de95b07fee974552c18f48fbe15a949c083030e66816ee99abc8acf7 not found: ID does not exist"
May 25 12:13:51.646515 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.644975    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c9dc7fc59-nx64x" podStartSLOduration=8.929069281 podStartE2EDuration="12.644957982s" podCreationTimestamp="2026-05-25 12:13:39 +0000 UTC" firstStartedPulling="2026-05-25 12:13:47.238585926 +0000 UTC m=+96.583846757" lastFinishedPulling="2026-05-25 12:13:50.954474613 +0000 UTC m=+100.299735458" observedRunningTime="2026-05-25 12:13:51.642860775 +0000 UTC m=+100.988121629" watchObservedRunningTime="2026-05-25 12:13:51.644957982 +0000 UTC m=+100.990218836"
May 25 12:13:51.667803 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.667447    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b" podStartSLOduration=1.6539923760000002 podStartE2EDuration="14.66743053s" podCreationTimestamp="2026-05-25 12:13:37 +0000 UTC" firstStartedPulling="2026-05-25 12:13:37.935985562 +0000 UTC m=+87.281246393" lastFinishedPulling="2026-05-25 12:13:50.949423701 +0000 UTC m=+100.294684547" observedRunningTime="2026-05-25 12:13:51.66727155 +0000 UTC m=+101.012532404" watchObservedRunningTime="2026-05-25 12:13:51.66743053 +0000 UTC m=+101.012691384"
May 25 12:13:51.694342 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.694268    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg" podStartSLOduration=10.219167428 podStartE2EDuration="13.694256345s" podCreationTimestamp="2026-05-25 12:13:38 +0000 UTC" firstStartedPulling="2026-05-25 12:13:47.473183394 +0000 UTC m=+96.818444229" lastFinishedPulling="2026-05-25 12:13:50.948272315 +0000 UTC m=+100.293533146" observedRunningTime="2026-05-25 12:13:51.693807056 +0000 UTC m=+101.039067910" watchObservedRunningTime="2026-05-25 12:13:51.694256345 +0000 UTC m=+101.039517200"
May 25 12:13:51.717854 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.717796    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:13:51.727633 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:51.727609    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-574b4949f8-xwf72"]
May 25 12:13:52.329748 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:52.329701    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:13:52.642671 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:52.642582    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"}
May 25 12:13:52.642671 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:52.642630    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerStarted","Data":"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"}
May 25 12:13:52.651873 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:52.651844    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5695b7996-2ng9b"
May 25 12:13:52.671635 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:52.671582    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.361041569 podStartE2EDuration="17.671564102s" podCreationTimestamp="2026-05-25 12:13:35 +0000 UTC" firstStartedPulling="2026-05-25 12:13:36.638105905 +0000 UTC m=+85.983366740" lastFinishedPulling="2026-05-25 12:13:50.948628428 +0000 UTC m=+100.293889273" observedRunningTime="2026-05-25 12:13:52.669385295 +0000 UTC m=+102.014646149" watchObservedRunningTime="2026-05-25 12:13:52.671564102 +0000 UTC m=+102.016824958"
May 25 12:13:53.221302 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:53.221271    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" path="/var/lib/kubelet/pods/79fa6949-f9b0-4080-a066-cb832c04b1e0/volumes"
May 25 12:13:53.870275 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:53.870238    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:13:59.087891 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:59.087857    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:13:59.088406 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:13:59.087903    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:14:08.082298 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.082233    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-558f5c76b6-dfdtg" podUID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" containerName="console" containerID="cri-o://57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b" gracePeriod=15
May 25 12:14:08.354503 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.354484    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-558f5c76b6-dfdtg_cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e/console/0.log"
May 25 12:14:08.354602 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.354544    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:14:08.379624 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379599    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv9qh\" (UniqueName: \"kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.379750 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379643    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.379750 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379669    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.379750 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379705    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.379750 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379741    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.379934 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.379785    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert\") pod \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\" (UID: \"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e\") "
May 25 12:14:08.380254 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380147    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config" (OuterVolumeSpecName: "console-config") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:08.380254 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380166    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:08.380254 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380225    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:08.380517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380326    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-oauth-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.380517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380346    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.380517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.380360    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-service-ca\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.382069 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.382046    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:08.382192 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.382169    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:08.382266 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.382220    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh" (OuterVolumeSpecName: "kube-api-access-hv9qh") pod "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" (UID: "cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e"). InnerVolumeSpecName "kube-api-access-hv9qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:14:08.480960 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.480938    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.480960 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.480959    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv9qh\" (UniqueName: \"kubernetes.io/projected/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-kube-api-access-hv9qh\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.481095 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.480968    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e-console-oauth-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:08.703240 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703158    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-558f5c76b6-dfdtg_cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e/console/0.log"
May 25 12:14:08.703240 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703195    2575 generic.go:358] "Generic (PLEG): container finished" podID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" containerID="57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b" exitCode=2
May 25 12:14:08.703437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703256    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558f5c76b6-dfdtg" event={"ID":"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e","Type":"ContainerDied","Data":"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"}
May 25 12:14:08.703437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703280    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558f5c76b6-dfdtg" event={"ID":"cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e","Type":"ContainerDied","Data":"17f472f89b0348146d5b018f8af49c12d160426b2980c645a6dcebf1932eab33"}
May 25 12:14:08.703437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703299    2575 scope.go:117] "RemoveContainer" containerID="57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"
May 25 12:14:08.703437 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.703318    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558f5c76b6-dfdtg"
May 25 12:14:08.712683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.712667    2575 scope.go:117] "RemoveContainer" containerID="57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"
May 25 12:14:08.712947 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:08.712926    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b\": container with ID starting with 57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b not found: ID does not exist" containerID="57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"
May 25 12:14:08.713003 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.712955    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b"} err="failed to get container status \"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b\": rpc error: code = NotFound desc = could not find container \"57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b\": container with ID starting with 57137744914f33886ff08ad3d552748ef083a48d6e0fb6af1eea1d6b953c063b not found: ID does not exist"
May 25 12:14:08.724184 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.724163    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:14:08.728841 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:08.728818    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558f5c76b6-dfdtg"]
May 25 12:14:09.220375 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:09.220343    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" path="/var/lib/kubelet/pods/cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e/volumes"
May 25 12:14:17.351971 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.351889    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59cd848654-wc4hf" podUID="2bf31700-d393-4c6e-a650-a9301a33025f" containerName="console" containerID="cri-o://358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569" gracePeriod=15
May 25 12:14:17.616936 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.616912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59cd848654-wc4hf_2bf31700-d393-4c6e-a650-a9301a33025f/console/0.log"
May 25 12:14:17.617045 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.616976    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:14:17.644093 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644072    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644243 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644109    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644243 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644130    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77glc\" (UniqueName: \"kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644358 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644256    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644358 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644315    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644464 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644369    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644464 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644410    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config\") pod \"2bf31700-d393-4c6e-a650-a9301a33025f\" (UID: \"2bf31700-d393-4c6e-a650-a9301a33025f\") "
May 25 12:14:17.644565 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.644482    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:17.645296 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.645071    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:17.645422 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.645293    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config" (OuterVolumeSpecName: "console-config") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:17.645490 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.645429    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca" (OuterVolumeSpecName: "service-ca") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:17.647671 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.647637    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:17.648016 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.647981    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc" (OuterVolumeSpecName: "kube-api-access-77glc") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "kube-api-access-77glc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:14:17.651132 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651099    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2bf31700-d393-4c6e-a650-a9301a33025f" (UID: "2bf31700-d393-4c6e-a650-a9301a33025f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:17.651515 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651496    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-trusted-ca-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651599 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651522    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-oauth-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651599 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651545    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77glc\" (UniqueName: \"kubernetes.io/projected/2bf31700-d393-4c6e-a650-a9301a33025f-kube-api-access-77glc\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651599 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651563    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf31700-d393-4c6e-a650-a9301a33025f-console-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651599 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651577    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-service-ca\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651599 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651595    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-oauth-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.651831 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.651610    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf31700-d393-4c6e-a650-a9301a33025f-console-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:17.730961 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.730940    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59cd848654-wc4hf_2bf31700-d393-4c6e-a650-a9301a33025f/console/0.log"
May 25 12:14:17.731054 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.730975    2575 generic.go:358] "Generic (PLEG): container finished" podID="2bf31700-d393-4c6e-a650-a9301a33025f" containerID="358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569" exitCode=2
May 25 12:14:17.731054 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.731015    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd848654-wc4hf" event={"ID":"2bf31700-d393-4c6e-a650-a9301a33025f","Type":"ContainerDied","Data":"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"}
May 25 12:14:17.731054 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.731042    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd848654-wc4hf" event={"ID":"2bf31700-d393-4c6e-a650-a9301a33025f","Type":"ContainerDied","Data":"03fe3be2a255b29a4437ec40a4feada77d91e3add01de332e9de43a73bd3c755"}
May 25 12:14:17.731182 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.731055    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd848654-wc4hf"
May 25 12:14:17.731182 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.731061    2575 scope.go:117] "RemoveContainer" containerID="358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"
May 25 12:14:17.739742 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.739717    2575 scope.go:117] "RemoveContainer" containerID="358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"
May 25 12:14:17.739977 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:17.739956    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569\": container with ID starting with 358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569 not found: ID does not exist" containerID="358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"
May 25 12:14:17.740028 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.739986    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569"} err="failed to get container status \"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569\": rpc error: code = NotFound desc = could not find container \"358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569\": container with ID starting with 358cdbeaece4ddbf734ba504b21f6e4072972bc86992a6f66e60300cba5cb569 not found: ID does not exist"
May 25 12:14:17.751625 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.751588    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:14:17.757385 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:17.757363    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cd848654-wc4hf"]
May 25 12:14:19.093389 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:19.093363    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:14:19.097253 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:19.097228    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fd48fc8df-xhghg"
May 25 12:14:19.221803 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:19.221772    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf31700-d393-4c6e-a650-a9301a33025f" path="/var/lib/kubelet/pods/2bf31700-d393-4c6e-a650-a9301a33025f/volumes"
May 25 12:14:53.188750 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.188656    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189132    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf31700-d393-4c6e-a650-a9301a33025f" containerName="console"
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189152    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf31700-d393-4c6e-a650-a9301a33025f" containerName="console"
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189187    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerName="registry"
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189215    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerName="registry"
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189228    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" containerName="console"
May 25 12:14:53.189286 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189237    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" containerName="console"
May 25 12:14:53.189586 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189306    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bf31700-d393-4c6e-a650-a9301a33025f" containerName="console"
May 25 12:14:53.189586 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189316    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="79fa6949-f9b0-4080-a066-cb832c04b1e0" containerName="registry"
May 25 12:14:53.189586 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.189329    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdb36f20-9dc6-4fba-8022-a1fcbce4bc6e" containerName="console"
May 25 12:14:53.192683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.192660    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.194450 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.194419    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 12:14:53.194575 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.194556    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 12:14:53.194630 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.194560    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 12:14:53.195033 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.195016    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 12:14:53.195083 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.195033    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 12:14:53.195158 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.195141    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l8gmm\""
May 25 12:14:53.199825 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.199775    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 12:14:53.201745 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.201724    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:14:53.328031 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.327999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328124 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328124 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328124 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328247 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328247 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.328247 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.328223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dll99\" (UniqueName: \"kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.428821 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428786    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.428946 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428827    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.428946 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428851    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.428946 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.428946 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428906    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429136 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428950    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429136 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.428975    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dll99\" (UniqueName: \"kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429654 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.429625    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429751 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.429661    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429793 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.429754    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.429847 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.429828    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.431411 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.431385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.431497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.431425    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.437293 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.437270    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dll99\" (UniqueName: \"kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99\") pod \"console-5b4b564c6f-kbvc7\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") " pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.504283 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.504221    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:14:53.625855 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.625825    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:14:53.628811 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:14:53.628772    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07998e5_1576_4b97_90af_20bd334874e6.slice/crio-ef2b0566e430056b625e46952d4155a21034bcc5ccbebdcce15eafc7626e31b0 WatchSource:0}: Error finding container ef2b0566e430056b625e46952d4155a21034bcc5ccbebdcce15eafc7626e31b0: Status 404 returned error can't find the container with id ef2b0566e430056b625e46952d4155a21034bcc5ccbebdcce15eafc7626e31b0
May 25 12:14:53.844498 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.844465    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b564c6f-kbvc7" event={"ID":"a07998e5-1576-4b97-90af-20bd334874e6","Type":"ContainerStarted","Data":"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"}
May 25 12:14:53.844498 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.844501    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b564c6f-kbvc7" event={"ID":"a07998e5-1576-4b97-90af-20bd334874e6","Type":"ContainerStarted","Data":"ef2b0566e430056b625e46952d4155a21034bcc5ccbebdcce15eafc7626e31b0"}
May 25 12:14:53.861279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:53.861235    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b4b564c6f-kbvc7" podStartSLOduration=0.861220727 podStartE2EDuration="861.220727ms" podCreationTimestamp="2026-05-25 12:14:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:14:53.860089985 +0000 UTC m=+163.205350838" watchObservedRunningTime="2026-05-25 12:14:53.861220727 +0000 UTC m=+163.206481572"
May 25 12:14:54.831011 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.830977    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:54.831464 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831408    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="alertmanager" containerID="cri-o://461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca" gracePeriod=120
May 25 12:14:54.831524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831459    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-metric" containerID="cri-o://475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44" gracePeriod=120
May 25 12:14:54.831569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831531    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-web" containerID="cri-o://6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b" gracePeriod=120
May 25 12:14:54.831569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831549    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="config-reloader" containerID="cri-o://711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81" gracePeriod=120
May 25 12:14:54.831651 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831530    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="prom-label-proxy" containerID="cri-o://aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d" gracePeriod=120
May 25 12:14:54.831651 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:54.831590    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy" containerID="cri-o://d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23" gracePeriod=120
May 25 12:14:55.853569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853528    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d" exitCode=0
May 25 12:14:55.853569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853557    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44" exitCode=0
May 25 12:14:55.853569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853564    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23" exitCode=0
May 25 12:14:55.853569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853572    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81" exitCode=0
May 25 12:14:55.853569 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853580    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca" exitCode=0
May 25 12:14:55.854105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853605    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"}
May 25 12:14:55.854105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853649    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"}
May 25 12:14:55.854105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853664    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"}
May 25 12:14:55.854105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853679    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"}
May 25 12:14:55.854105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:55.853692    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"}
May 25 12:14:56.074955 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.074926    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:56.251365 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251283    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251365 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251329    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251367    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251398    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251440    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251478    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251508    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251533    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251559    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251601    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251648    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqv9r\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251695    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251721    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets\") pod \"707c2144-c2e7-47d1-8a06-327036ca4674\" (UID: \"707c2144-c2e7-47d1-8a06-327036ca4674\") "
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251750    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:14:56.251931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251870    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:56.252261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.251981    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-main-db\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.252261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.252003    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.252826 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.252792    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:14:56.254377 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.254340    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume" (OuterVolumeSpecName: "config-volume") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.254966 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.254919    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.254966 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.254950    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.255121 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.254964    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.255303 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.255253    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out" (OuterVolumeSpecName: "config-out") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:14:56.255422 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.255314    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:14:56.255422 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.255330    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.255541 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.255523    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r" (OuterVolumeSpecName: "kube-api-access-rqv9r") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "kube-api-access-rqv9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:14:56.258693 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.258667    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.265766 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.265743    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config" (OuterVolumeSpecName: "web-config") pod "707c2144-c2e7-47d1-8a06-327036ca4674" (UID: "707c2144-c2e7-47d1-8a06-327036ca4674"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:14:56.353326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353287    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqv9r\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-kube-api-access-rqv9r\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353325    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707c2144-c2e7-47d1-8a06-327036ca4674-config-out\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353326 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353340    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707c2144-c2e7-47d1-8a06-327036ca4674-tls-assets\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353434    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353452    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353482    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-config-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353499    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-cluster-tls-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353522 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353517    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-web-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353534    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707c2144-c2e7-47d1-8a06-327036ca4674-metrics-client-ca\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353548    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-main-tls\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.353672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.353562    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707c2144-c2e7-47d1-8a06-327036ca4674-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:14:56.859355 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.859322    2575 generic.go:358] "Generic (PLEG): container finished" podID="707c2144-c2e7-47d1-8a06-327036ca4674" containerID="6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b" exitCode=0
May 25 12:14:56.859719 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.859406    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"}
May 25 12:14:56.859719 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.859442    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:56.859719 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.859457    2575 scope.go:117] "RemoveContainer" containerID="aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"
May 25 12:14:56.859719 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.859447    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707c2144-c2e7-47d1-8a06-327036ca4674","Type":"ContainerDied","Data":"ce02b20614b24af3acc0c32f5f2cdf037fa1e0633786a77f1530a40080fb3a74"}
May 25 12:14:56.867346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.867323    2575 scope.go:117] "RemoveContainer" containerID="475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"
May 25 12:14:56.874152 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.874134    2575 scope.go:117] "RemoveContainer" containerID="d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"
May 25 12:14:56.880392 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.880366    2575 scope.go:117] "RemoveContainer" containerID="6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"
May 25 12:14:56.882888 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.882870    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:56.888363 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.888342    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:56.889320 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.889305    2575 scope.go:117] "RemoveContainer" containerID="711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"
May 25 12:14:56.895714 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.895700    2575 scope.go:117] "RemoveContainer" containerID="461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"
May 25 12:14:56.901786 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.901769    2575 scope.go:117] "RemoveContainer" containerID="10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983"
May 25 12:14:56.907909 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.907893    2575 scope.go:117] "RemoveContainer" containerID="aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"
May 25 12:14:56.908161 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.908143    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d\": container with ID starting with aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d not found: ID does not exist" containerID="aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"
May 25 12:14:56.908224 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908168    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d"} err="failed to get container status \"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d\": rpc error: code = NotFound desc = could not find container \"aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d\": container with ID starting with aab9df05856277ff9fe0e9284e36f9562ac9608fcdf31c02af864cc6ee5f6e6d not found: ID does not exist"
May 25 12:14:56.908224 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908186    2575 scope.go:117] "RemoveContainer" containerID="475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"
May 25 12:14:56.908454 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.908437    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44\": container with ID starting with 475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44 not found: ID does not exist" containerID="475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"
May 25 12:14:56.908502 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908458    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44"} err="failed to get container status \"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44\": rpc error: code = NotFound desc = could not find container \"475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44\": container with ID starting with 475a45dfb9ec4556eba41d9311b3cb3ed63ced02522607a1dbcfcd754fcbdc44 not found: ID does not exist"
May 25 12:14:56.908502 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908474    2575 scope.go:117] "RemoveContainer" containerID="d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"
May 25 12:14:56.908723 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.908705    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23\": container with ID starting with d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23 not found: ID does not exist" containerID="d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"
May 25 12:14:56.908797 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908727    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23"} err="failed to get container status \"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23\": rpc error: code = NotFound desc = could not find container \"d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23\": container with ID starting with d0ee1026d664156fb836ee7f96003b69f3f6642b2af7c34f312b36e74184bb23 not found: ID does not exist"
May 25 12:14:56.908797 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908740    2575 scope.go:117] "RemoveContainer" containerID="6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"
May 25 12:14:56.908919 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.908905    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b\": container with ID starting with 6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b not found: ID does not exist" containerID="6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"
May 25 12:14:56.908954 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908922    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b"} err="failed to get container status \"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b\": rpc error: code = NotFound desc = could not find container \"6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b\": container with ID starting with 6cc99926c0f66bbb5eee8b9db7bfdc5456997474230d07e46e53e2b5d2b2b19b not found: ID does not exist"
May 25 12:14:56.908954 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.908935    2575 scope.go:117] "RemoveContainer" containerID="711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"
May 25 12:14:56.909127 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.909110    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81\": container with ID starting with 711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81 not found: ID does not exist" containerID="711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"
May 25 12:14:56.909171 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.909133    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81"} err="failed to get container status \"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81\": rpc error: code = NotFound desc = could not find container \"711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81\": container with ID starting with 711d8861d06e80a5789c6b0b6ba39b28b4c0ae24d3839cd06cd5120d86bc5b81 not found: ID does not exist"
May 25 12:14:56.909171 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.909150    2575 scope.go:117] "RemoveContainer" containerID="461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"
May 25 12:14:56.909347 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.909331    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca\": container with ID starting with 461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca not found: ID does not exist" containerID="461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"
May 25 12:14:56.909384 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.909351    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca"} err="failed to get container status \"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca\": rpc error: code = NotFound desc = could not find container \"461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca\": container with ID starting with 461daea6f818a3883f67cad83c3498c7980be2060e4e2ae0ffd9bfed76c846ca not found: ID does not exist"
May 25 12:14:56.909384 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.909363    2575 scope.go:117] "RemoveContainer" containerID="10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983"
May 25 12:14:56.909542 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:14:56.909525    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983\": container with ID starting with 10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983 not found: ID does not exist" containerID="10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983"
May 25 12:14:56.909585 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.909545    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983"} err="failed to get container status \"10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983\": rpc error: code = NotFound desc = could not find container \"10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983\": container with ID starting with 10f541c60a065045e32bde1fc2b2abba823c31b210d4a49e9f04b7501ab5a983 not found: ID does not exist"
May 25 12:14:56.914860 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.914841    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:56.915139 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915127    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-web"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915141    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-web"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915151    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="init-config-reloader"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915157    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="init-config-reloader"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915165    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915171    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915178    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="prom-label-proxy"
May 25 12:14:56.915190 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915183    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="prom-label-proxy"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915215    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="alertmanager"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915239    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="alertmanager"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915245    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="config-reloader"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915250    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="config-reloader"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915260    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-metric"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915268    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-metric"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915336    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="prom-label-proxy"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915350    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="alertmanager"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915359    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-web"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915365    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915370    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="kube-rbac-proxy-metric"
May 25 12:14:56.915452 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.915377    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" containerName="config-reloader"
May 25 12:14:56.920230 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.920191    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:56.921887 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.921867    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 12:14:56.921992 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.921978    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 12:14:56.922052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922013    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-llc2z\""
May 25 12:14:56.922101 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922059    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 12:14:56.922101 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922095    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 12:14:56.922228 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922176    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 12:14:56.922399 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922376    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 12:14:56.922399 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922386    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 12:14:56.922497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.922376    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 12:14:56.927396 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.927371    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 12:14:56.932451 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:56.932426    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:57.058378 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-config-out\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-web-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmxj2\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-kube-api-access-nmxj2\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058821 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058821 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.058821 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.058766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160033 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.159938    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160033 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.159996    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160033 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160031    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160059    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-config-out\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160089    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160113    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160137    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-web-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160271    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160299    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160361    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160385    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmxj2\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-kube-api-access-nmxj2\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160442    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.160676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.160520    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.161537 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.161167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163189 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f47be61-6c55-42b4-8d10-22554d789a81-config-out\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163380 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163359    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163441 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163402    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163482    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163548 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163493    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163841 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163820    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-web-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163856    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.163981 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.163939    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.164110 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.164092    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f47be61-6c55-42b4-8d10-22554d789a81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.165232 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.165213    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f47be61-6c55-42b4-8d10-22554d789a81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.171699 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.171683    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmxj2\" (UniqueName: \"kubernetes.io/projected/1f47be61-6c55-42b4-8d10-22554d789a81-kube-api-access-nmxj2\") pod \"alertmanager-main-0\" (UID: \"1f47be61-6c55-42b4-8d10-22554d789a81\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.220369 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.220343    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707c2144-c2e7-47d1-8a06-327036ca4674" path="/var/lib/kubelet/pods/707c2144-c2e7-47d1-8a06-327036ca4674/volumes"
May 25 12:14:57.232798 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.232780    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 12:14:57.357618 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.357595    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 12:14:57.359742 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:14:57.359712    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f47be61_6c55_42b4_8d10_22554d789a81.slice/crio-15cd3ef2ff2f62872c2bc82ce3bf35329a2f07f19bb1a8e7e38e5452e9700ab3 WatchSource:0}: Error finding container 15cd3ef2ff2f62872c2bc82ce3bf35329a2f07f19bb1a8e7e38e5452e9700ab3: Status 404 returned error can't find the container with id 15cd3ef2ff2f62872c2bc82ce3bf35329a2f07f19bb1a8e7e38e5452e9700ab3
May 25 12:14:57.864392 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.864360    2575 generic.go:358] "Generic (PLEG): container finished" podID="1f47be61-6c55-42b4-8d10-22554d789a81" containerID="8c6fdce787ffc73236b001ce67d4a6a1326a475659745224c5bbdb71da8bf04f" exitCode=0
May 25 12:14:57.864773 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.864396    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerDied","Data":"8c6fdce787ffc73236b001ce67d4a6a1326a475659745224c5bbdb71da8bf04f"}
May 25 12:14:57.864773 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:57.864416    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"15cd3ef2ff2f62872c2bc82ce3bf35329a2f07f19bb1a8e7e38e5452e9700ab3"}
May 25 12:14:58.870791 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870753    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"077b030fba10225e653f2544adae865ee9772307a38ae63640f0afc1fe1d1f43"}
May 25 12:14:58.871167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870797    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"44dee6690c7a45ef042bc4c2dee780c853b0ad2310c8740755342a8042de4500"}
May 25 12:14:58.871167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870810    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"887654fc1fe49140c441669dec05044d16ab9606a1eefca07c9f1360f162c516"}
May 25 12:14:58.871167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870819    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"ead880428d484331869c9494a362714bce3b2b0a7b7033d14e26f0961863d880"}
May 25 12:14:58.871167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870829    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"a9f3522646540e970a5eae0236d116b1641773b28301ee281d50c7e9db950a68"}
May 25 12:14:58.871167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.870837    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f47be61-6c55-42b4-8d10-22554d789a81","Type":"ContainerStarted","Data":"f5c19d6c4223b9c89e4d2b90a9e5e2078568e25ee5911583b92044d7d3b20ec2"}
May 25 12:14:58.895792 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:14:58.895738    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.895718785 podStartE2EDuration="2.895718785s" podCreationTimestamp="2026-05-25 12:14:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:14:58.893975723 +0000 UTC m=+168.239236576" watchObservedRunningTime="2026-05-25 12:14:58.895718785 +0000 UTC m=+168.240979638"
May 25 12:15:03.504920 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:03.504881    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:15:03.505318 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:03.504934    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:15:03.509588 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:03.509566    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:15:03.890080 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:03.890051    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:15:35.263951 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.263911    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"]
May 25 12:15:35.267518 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.267499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.269450 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.269421    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 12:15:35.269587 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.269421    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 12:15:35.269759 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.269742    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gqhc9\""
May 25 12:15:35.273795 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.273767    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"]
May 25 12:15:35.375459 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.375417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w75f5\" (UniqueName: \"kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.375459 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.375463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.375696 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.375543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.476524 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.476489    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w75f5\" (UniqueName: \"kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.476635 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.476531    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.476635 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.476568    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.476902 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.476878    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.476970 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.476922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.487711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.487686    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w75f5\" (UniqueName: \"kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.577622 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.577592    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:35.729950 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.729924    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"]
May 25 12:15:35.732575 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:15:35.732548    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf1f784_1dec_46cb_8a9e_ff0435403264.slice/crio-a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c WatchSource:0}: Error finding container a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c: Status 404 returned error can't find the container with id a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c
May 25 12:15:35.982272 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:35.982174    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm" event={"ID":"eaf1f784-1dec-46cb-8a9e-ff0435403264","Type":"ContainerStarted","Data":"a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c"}
May 25 12:15:44.010478 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:44.010382    2575 generic.go:358] "Generic (PLEG): container finished" podID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerID="cccfa634c77ab72ba138671ba7ca8127c01da07a22e66c0d1d1c49d48a3be8b4" exitCode=0
May 25 12:15:44.010478 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:44.010460    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm" event={"ID":"eaf1f784-1dec-46cb-8a9e-ff0435403264","Type":"ContainerDied","Data":"cccfa634c77ab72ba138671ba7ca8127c01da07a22e66c0d1d1c49d48a3be8b4"}
May 25 12:15:47.020756 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:47.020719    2575 generic.go:358] "Generic (PLEG): container finished" podID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerID="daa332deed9ce3cc81620431bb14a92086828cda028f77a9f79c4f5a83fa13d3" exitCode=0
May 25 12:15:47.021159 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:47.020809    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm" event={"ID":"eaf1f784-1dec-46cb-8a9e-ff0435403264","Type":"ContainerDied","Data":"daa332deed9ce3cc81620431bb14a92086828cda028f77a9f79c4f5a83fa13d3"}
May 25 12:15:54.045945 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:54.045902    2575 generic.go:358] "Generic (PLEG): container finished" podID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerID="ec009970fcde7a1c2ad3d7fc0789044169cc1349258e302fca4cb715932d5567" exitCode=0
May 25 12:15:54.046365 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:54.045975    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm" event={"ID":"eaf1f784-1dec-46cb-8a9e-ff0435403264","Type":"ContainerDied","Data":"ec009970fcde7a1c2ad3d7fc0789044169cc1349258e302fca4cb715932d5567"}
May 25 12:15:55.171934 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.171900    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:55.353959 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.353856    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle\") pod \"eaf1f784-1dec-46cb-8a9e-ff0435403264\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") "
May 25 12:15:55.353959 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.353910    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util\") pod \"eaf1f784-1dec-46cb-8a9e-ff0435403264\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") "
May 25 12:15:55.353959 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.353940    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w75f5\" (UniqueName: \"kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5\") pod \"eaf1f784-1dec-46cb-8a9e-ff0435403264\" (UID: \"eaf1f784-1dec-46cb-8a9e-ff0435403264\") "
May 25 12:15:55.354578 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.354546    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle" (OuterVolumeSpecName: "bundle") pod "eaf1f784-1dec-46cb-8a9e-ff0435403264" (UID: "eaf1f784-1dec-46cb-8a9e-ff0435403264"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:15:55.356246 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.356223    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5" (OuterVolumeSpecName: "kube-api-access-w75f5") pod "eaf1f784-1dec-46cb-8a9e-ff0435403264" (UID: "eaf1f784-1dec-46cb-8a9e-ff0435403264"). InnerVolumeSpecName "kube-api-access-w75f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:15:55.358587 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.358568    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util" (OuterVolumeSpecName: "util") pod "eaf1f784-1dec-46cb-8a9e-ff0435403264" (UID: "eaf1f784-1dec-46cb-8a9e-ff0435403264"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:15:55.454867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.454815    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-util\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:15:55.454867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.454862    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w75f5\" (UniqueName: \"kubernetes.io/projected/eaf1f784-1dec-46cb-8a9e-ff0435403264-kube-api-access-w75f5\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:15:55.454867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:55.454873    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaf1f784-1dec-46cb-8a9e-ff0435403264-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:15:56.053336 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:56.053296    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm" event={"ID":"eaf1f784-1dec-46cb-8a9e-ff0435403264","Type":"ContainerDied","Data":"a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c"}
May 25 12:15:56.053336 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:56.053334    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cmq9lm"
May 25 12:15:56.053549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:15:56.053337    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a890ceb79768319d26e170d079a6e83439796a78703ffa885e2192b431925e0c"
May 25 12:16:01.988217 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988165    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"]
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988505    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="extract"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988516    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="extract"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="util"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988534    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="util"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988542    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="pull"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988547    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="pull"
May 25 12:16:01.988703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.988596    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaf1f784-1dec-46cb-8a9e-ff0435403264" containerName="extract"
May 25 12:16:01.994863 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.994838    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:01.996625 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.996600    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 25 12:16:01.996749 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.996644    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-txv7n\""
May 25 12:16:01.996749 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.996656    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 25 12:16:01.996749 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:01.996602    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 25 12:16:02.000795 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.000759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vgqc\" (UniqueName: \"kubernetes.io/projected/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-kube-api-access-7vgqc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.000926 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.000884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.002963 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.002943    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"]
May 25 12:16:02.101837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.101797    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgqc\" (UniqueName: \"kubernetes.io/projected/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-kube-api-access-7vgqc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.102024 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.101850    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.104186 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.104155    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.110786 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.110757    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vgqc\" (UniqueName: \"kubernetes.io/projected/9a9defe9-9fce-4d8b-8033-c6ea01afd0ce-kube-api-access-7vgqc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-4frmq\" (UID: \"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.306875 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.306833    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:02.445722 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:02.445692    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"]
May 25 12:16:02.448838 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:16:02.448795    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9defe9_9fce_4d8b_8033_c6ea01afd0ce.slice/crio-d70bf31d67ba72b04249af67f601adc806f84d3c36d7856254190b91395765c9 WatchSource:0}: Error finding container d70bf31d67ba72b04249af67f601adc806f84d3c36d7856254190b91395765c9: Status 404 returned error can't find the container with id d70bf31d67ba72b04249af67f601adc806f84d3c36d7856254190b91395765c9
May 25 12:16:03.075386 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:03.075351    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq" event={"ID":"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce","Type":"ContainerStarted","Data":"d70bf31d67ba72b04249af67f601adc806f84d3c36d7856254190b91395765c9"}
May 25 12:16:09.828328 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.828293    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-54wmt"]
May 25 12:16:09.831812 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.831794    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.833576 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.833542    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 25 12:16:09.833683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.833571    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 25 12:16:09.833683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.833622    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-n79p4\""
May 25 12:16:09.838461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.838439    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-54wmt"]
May 25 12:16:09.866672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.866635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.866672 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.866672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985px\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-kube-api-access-985px\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.866850 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.866697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2c597f06-b6fb-46e7-a115-cd27d27e157a-cabundle0\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.967532 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.967500    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.967717 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.967537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-985px\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-kube-api-access-985px\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.967717 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.967583    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2c597f06-b6fb-46e7-a115-cd27d27e157a-cabundle0\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.967717 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:09.967662    2575 secret.go:281] references non-existent secret key: ca.crt
May 25 12:16:09.967717 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:09.967679    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 12:16:09.967717 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:09.967693    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-54wmt: references non-existent secret key: ca.crt
May 25 12:16:09.967929 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:09.967754    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates podName:2c597f06-b6fb-46e7-a115-cd27d27e157a nodeName:}" failed. No retries permitted until 2026-05-25 12:16:10.467734411 +0000 UTC m=+239.812995255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates") pod "keda-operator-ffbb595cb-54wmt" (UID: "2c597f06-b6fb-46e7-a115-cd27d27e157a") : references non-existent secret key: ca.crt
May 25 12:16:09.968158 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.968137    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2c597f06-b6fb-46e7-a115-cd27d27e157a-cabundle0\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:09.977491 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:09.977467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-985px\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-kube-api-access-985px\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:10.065741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.065701    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"]
May 25 12:16:10.069156 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.069132    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.070648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.070626    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 25 12:16:10.075000 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.074979    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"]
May 25 12:16:10.100519 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.100416    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq" event={"ID":"9a9defe9-9fce-4d8b-8033-c6ea01afd0ce","Type":"ContainerStarted","Data":"16f5e172aaf518f83d8774f1752e18eb1631ff4ce2128c77f348dec103c760c3"}
May 25 12:16:10.100519 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.100495    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:10.118868 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.118809    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq" podStartSLOduration=2.235272463 podStartE2EDuration="9.118796436s" podCreationTimestamp="2026-05-25 12:16:01 +0000 UTC" firstStartedPulling="2026-05-25 12:16:02.450596267 +0000 UTC m=+231.795857097" lastFinishedPulling="2026-05-25 12:16:09.334120223 +0000 UTC m=+238.679381070" observedRunningTime="2026-05-25 12:16:10.11765711 +0000 UTC m=+239.462917955" watchObservedRunningTime="2026-05-25 12:16:10.118796436 +0000 UTC m=+239.464057288"
May 25 12:16:10.169647 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.169614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/02804004-620f-4854-9b0f-cc34a9921ce7-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.169647 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.169648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.169832 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.169756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkw92\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-kube-api-access-zkw92\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.270881 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.270850    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/02804004-620f-4854-9b0f-cc34a9921ce7-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.271030 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.270889    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.271030 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.270996    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkw92\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-kube-api-access-zkw92\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.271163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.271115    2575 secret.go:281] references non-existent secret key: tls.crt
May 25 12:16:10.271163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.271140    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 25 12:16:10.271163 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.271160    2575 projected.go:264] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
May 25 12:16:10.271340 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.271182    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 25 12:16:10.271340 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.271270    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates podName:02804004-620f-4854-9b0f-cc34a9921ce7 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:10.771251056 +0000 UTC m=+240.116511915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates") pod "keda-metrics-apiserver-7c9f485588-2gdr9" (UID: "02804004-620f-4854-9b0f-cc34a9921ce7") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 25 12:16:10.271340 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.271321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/02804004-620f-4854-9b0f-cc34a9921ce7-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.279100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.279072    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkw92\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-kube-api-access-zkw92\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.374218 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.374116    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-6926x"]
May 25 12:16:10.377417 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.377401    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.379031 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.379008    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 25 12:16:10.384270 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.384246    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-6926x"]
May 25 12:16:10.472897 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.472863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8vkp\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-kube-api-access-w8vkp\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.472897 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.472906    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:10.473114 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.472924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.473114 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.473032    2575 secret.go:281] references non-existent secret key: ca.crt
May 25 12:16:10.473114 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.473044    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 12:16:10.473114 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.473052    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-54wmt: references non-existent secret key: ca.crt
May 25 12:16:10.473114 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.473106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates podName:2c597f06-b6fb-46e7-a115-cd27d27e157a nodeName:}" failed. No retries permitted until 2026-05-25 12:16:11.47309044 +0000 UTC m=+240.818351285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates") pod "keda-operator-ffbb595cb-54wmt" (UID: "2c597f06-b6fb-46e7-a115-cd27d27e157a") : references non-existent secret key: ca.crt
May 25 12:16:10.573558 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.573522    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8vkp\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-kube-api-access-w8vkp\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.573775 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.573568    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.573775 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.573659    2575 projected.go:264] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
May 25 12:16:10.573775 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.573677    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-cf49989db-6926x: secret "keda-admission-webhooks-certs" not found
May 25 12:16:10.573775 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.573729    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates podName:39f91e2d-3b7d-46f2-9d21-8bfcd2906768 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:11.073712526 +0000 UTC m=+240.418973357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates") pod "keda-admission-cf49989db-6926x" (UID: "39f91e2d-3b7d-46f2-9d21-8bfcd2906768") : secret "keda-admission-webhooks-certs" not found
May 25 12:16:10.582400 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.582369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8vkp\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-kube-api-access-w8vkp\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:10.775404 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:10.775307    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:10.775585 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.775472    2575 secret.go:281] references non-existent secret key: tls.crt
May 25 12:16:10.775585 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.775495    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 25 12:16:10.775585 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.775517    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9: references non-existent secret key: tls.crt
May 25 12:16:10.775736 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:10.775598    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates podName:02804004-620f-4854-9b0f-cc34a9921ce7 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:11.775578333 +0000 UTC m=+241.120839164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates") pod "keda-metrics-apiserver-7c9f485588-2gdr9" (UID: "02804004-620f-4854-9b0f-cc34a9921ce7") : references non-existent secret key: tls.crt
May 25 12:16:11.078506 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.078472    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:11.080860 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.080841    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/39f91e2d-3b7d-46f2-9d21-8bfcd2906768-certificates\") pod \"keda-admission-cf49989db-6926x\" (UID: \"39f91e2d-3b7d-46f2-9d21-8bfcd2906768\") " pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:11.291623 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.291592    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-n79p4\""
May 25 12:16:11.299837 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.299816    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:11.426810 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.426777    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-6926x"]
May 25 12:16:11.429979 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:16:11.429950    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f91e2d_3b7d_46f2_9d21_8bfcd2906768.slice/crio-39d1926e51b529f0408a1e7982c6faca911c01375da7f2c47897d01a8c039c8b WatchSource:0}: Error finding container 39d1926e51b529f0408a1e7982c6faca911c01375da7f2c47897d01a8c039c8b: Status 404 returned error can't find the container with id 39d1926e51b529f0408a1e7982c6faca911c01375da7f2c47897d01a8c039c8b
May 25 12:16:11.481461 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.481432    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:11.481626 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.481585    2575 secret.go:281] references non-existent secret key: ca.crt
May 25 12:16:11.481626 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.481604    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 12:16:11.481626 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.481615    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-54wmt: references non-existent secret key: ca.crt
May 25 12:16:11.481779 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.481681    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates podName:2c597f06-b6fb-46e7-a115-cd27d27e157a nodeName:}" failed. No retries permitted until 2026-05-25 12:16:13.481661192 +0000 UTC m=+242.826922036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates") pod "keda-operator-ffbb595cb-54wmt" (UID: "2c597f06-b6fb-46e7-a115-cd27d27e157a") : references non-existent secret key: ca.crt
May 25 12:16:11.783737 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:11.783664    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:11.783874 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.783796    2575 secret.go:281] references non-existent secret key: tls.crt
May 25 12:16:11.783874 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.783815    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 25 12:16:11.783874 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.783832    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9: references non-existent secret key: tls.crt
May 25 12:16:11.783970 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:11.783881    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates podName:02804004-620f-4854-9b0f-cc34a9921ce7 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:13.783867801 +0000 UTC m=+243.129128633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates") pod "keda-metrics-apiserver-7c9f485588-2gdr9" (UID: "02804004-620f-4854-9b0f-cc34a9921ce7") : references non-existent secret key: tls.crt
May 25 12:16:12.108004 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:12.107961    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-6926x" event={"ID":"39f91e2d-3b7d-46f2-9d21-8bfcd2906768","Type":"ContainerStarted","Data":"39d1926e51b529f0408a1e7982c6faca911c01375da7f2c47897d01a8c039c8b"}
May 25 12:16:13.112942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:13.112906    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-6926x" event={"ID":"39f91e2d-3b7d-46f2-9d21-8bfcd2906768","Type":"ContainerStarted","Data":"82f321375aa16829bfd08fdf46066d7cef7e066694e3cea82446c9584d18154a"}
May 25 12:16:13.113322 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:13.113037    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:13.127071 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:13.126975    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-6926x" podStartSLOduration=1.899717176 podStartE2EDuration="3.126961717s" podCreationTimestamp="2026-05-25 12:16:10 +0000 UTC" firstStartedPulling="2026-05-25 12:16:11.431885733 +0000 UTC m=+240.777146570" lastFinishedPulling="2026-05-25 12:16:12.65913028 +0000 UTC m=+242.004391111" observedRunningTime="2026-05-25 12:16:13.126633513 +0000 UTC m=+242.471894367" watchObservedRunningTime="2026-05-25 12:16:13.126961717 +0000 UTC m=+242.472222570"
May 25 12:16:13.496988 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:13.496887    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:13.497135 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.497026    2575 secret.go:281] references non-existent secret key: ca.crt
May 25 12:16:13.497135 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.497044    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 12:16:13.497135 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.497053    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-54wmt: references non-existent secret key: ca.crt
May 25 12:16:13.497135 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.497108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates podName:2c597f06-b6fb-46e7-a115-cd27d27e157a nodeName:}" failed. No retries permitted until 2026-05-25 12:16:17.497093422 +0000 UTC m=+246.842354253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates") pod "keda-operator-ffbb595cb-54wmt" (UID: "2c597f06-b6fb-46e7-a115-cd27d27e157a") : references non-existent secret key: ca.crt
May 25 12:16:13.799176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:13.799147    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:13.799391 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.799306    2575 secret.go:281] references non-existent secret key: tls.crt
May 25 12:16:13.799391 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.799326    2575 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 25 12:16:13.799391 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.799344    2575 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9: references non-existent secret key: tls.crt
May 25 12:16:13.799492 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:16:13.799396    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates podName:02804004-620f-4854-9b0f-cc34a9921ce7 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:17.799382563 +0000 UTC m=+247.144643394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates") pod "keda-metrics-apiserver-7c9f485588-2gdr9" (UID: "02804004-620f-4854-9b0f-cc34a9921ce7") : references non-existent secret key: tls.crt
May 25 12:16:17.525928 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.525896    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:17.528097 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.528071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2c597f06-b6fb-46e7-a115-cd27d27e157a-certificates\") pod \"keda-operator-ffbb595cb-54wmt\" (UID: \"2c597f06-b6fb-46e7-a115-cd27d27e157a\") " pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:17.642668 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.642633    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:17.776954 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.776887    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-54wmt"]
May 25 12:16:17.779827 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:16:17.779798    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c597f06_b6fb_46e7_a115_cd27d27e157a.slice/crio-bef3c199e337a8115a8cc4f94d2dc9afc99b3d7b7acca64f28097dde9c223a18 WatchSource:0}: Error finding container bef3c199e337a8115a8cc4f94d2dc9afc99b3d7b7acca64f28097dde9c223a18: Status 404 returned error can't find the container with id bef3c199e337a8115a8cc4f94d2dc9afc99b3d7b7acca64f28097dde9c223a18
May 25 12:16:17.828969 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.828943    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:17.831294 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.831276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/02804004-620f-4854-9b0f-cc34a9921ce7-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2gdr9\" (UID: \"02804004-620f-4854-9b0f-cc34a9921ce7\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:17.880559 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:17.880537    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:18.000277 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:18.000252    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"]
May 25 12:16:18.002662 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:16:18.002634    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02804004_620f_4854_9b0f_cc34a9921ce7.slice/crio-6cbc6c65b7012027bfaaf6b68960232c278f21d04c8172f3b7261cea09e35550 WatchSource:0}: Error finding container 6cbc6c65b7012027bfaaf6b68960232c278f21d04c8172f3b7261cea09e35550: Status 404 returned error can't find the container with id 6cbc6c65b7012027bfaaf6b68960232c278f21d04c8172f3b7261cea09e35550
May 25 12:16:18.129549 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:18.129523    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9" event={"ID":"02804004-620f-4854-9b0f-cc34a9921ce7","Type":"ContainerStarted","Data":"6cbc6c65b7012027bfaaf6b68960232c278f21d04c8172f3b7261cea09e35550"}
May 25 12:16:18.130383 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:18.130359    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-54wmt" event={"ID":"2c597f06-b6fb-46e7-a115-cd27d27e157a","Type":"ContainerStarted","Data":"bef3c199e337a8115a8cc4f94d2dc9afc99b3d7b7acca64f28097dde9c223a18"}
May 25 12:16:22.149725 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.149613    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9" event={"ID":"02804004-620f-4854-9b0f-cc34a9921ce7","Type":"ContainerStarted","Data":"870660dc051967367c3137bb017b53468669c23ca49e4c02fdfe315c9510c30a"}
May 25 12:16:22.149725 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.149691    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:22.151123 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.151098    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-54wmt" event={"ID":"2c597f06-b6fb-46e7-a115-cd27d27e157a","Type":"ContainerStarted","Data":"5506af646a2f197efa530fc57f1602e0fbf90649c67ce76c29528782d09bf8bf"}
May 25 12:16:22.151239 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.151228    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:16:22.167167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.167114    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9" podStartSLOduration=8.327373563 podStartE2EDuration="12.167096977s" podCreationTimestamp="2026-05-25 12:16:10 +0000 UTC" firstStartedPulling="2026-05-25 12:16:18.003994937 +0000 UTC m=+247.349255771" lastFinishedPulling="2026-05-25 12:16:21.843718339 +0000 UTC m=+251.188979185" observedRunningTime="2026-05-25 12:16:22.16512308 +0000 UTC m=+251.510383933" watchObservedRunningTime="2026-05-25 12:16:22.167096977 +0000 UTC m=+251.512357829"
May 25 12:16:22.181504 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:22.181448    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-54wmt" podStartSLOduration=9.113320587 podStartE2EDuration="13.181431625s" podCreationTimestamp="2026-05-25 12:16:09 +0000 UTC" firstStartedPulling="2026-05-25 12:16:17.780968366 +0000 UTC m=+247.126229196" lastFinishedPulling="2026-05-25 12:16:21.849079402 +0000 UTC m=+251.194340234" observedRunningTime="2026-05-25 12:16:22.179321212 +0000 UTC m=+251.524582056" watchObservedRunningTime="2026-05-25 12:16:22.181431625 +0000 UTC m=+251.526692478"
May 25 12:16:31.105676 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:31.105636    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-4frmq"
May 25 12:16:33.159064 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:33.159030    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2gdr9"
May 25 12:16:34.118343 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:34.118315    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-6926x"
May 25 12:16:43.155877 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:16:43.155845    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-54wmt"
May 25 12:17:11.169651 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:11.169622    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:17:11.171857 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:11.171835    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:17:11.173374 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:11.173352    2575 kubelet.go:1628] "Image garbage collection succeeded"
May 25 12:17:12.726515 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.726478    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:12.729813 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.729795    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.731497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.731462    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 25 12:17:12.731609 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.731505    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 25 12:17:12.731609 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.731589    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-wrzfv\""
May 25 12:17:12.731829 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.731814    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 25 12:17:12.735475 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.735451    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"]
May 25 12:17:12.738839 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.738812    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:12.738954 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.738855    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.740389 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.740372    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 25 12:17:12.740501 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.740373    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-g784l\""
May 25 12:17:12.745710 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.745691    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"]
May 25 12:17:12.766189 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.766157    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-47t5x"]
May 25 12:17:12.769810 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.769786    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.771391 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.771371    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-b92kn\""
May 25 12:17:12.771511 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.771413    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 25 12:17:12.778643 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.778614    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-47t5x"]
May 25 12:17:12.786729 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpx4\" (UniqueName: \"kubernetes.io/projected/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-kube-api-access-qfpx4\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.786953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-cert\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.786953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnfs\" (UniqueName: \"kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.786953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-data\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.786953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.786953 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.786927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjf9n\" (UniqueName: \"kubernetes.io/projected/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-kube-api-access-sjf9n\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.887518 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887474    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-cert\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.887728 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887561    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnfs\" (UniqueName: \"kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.887728 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887590    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-data\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.887728 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887657    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.887728 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887685    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjf9n\" (UniqueName: \"kubernetes.io/projected/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-kube-api-access-sjf9n\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.887728 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887725    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpx4\" (UniqueName: \"kubernetes.io/projected/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-kube-api-access-qfpx4\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.888006 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:17:12.887753    2575 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 25 12:17:12.888006 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:17:12.887816    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert podName:23f385a3-7158-4868-a6e6-072696452b58 nodeName:}" failed. No retries permitted until 2026-05-25 12:17:13.387796308 +0000 UTC m=+302.733057160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert") pod "kserve-controller-manager-6768985688-dzrzf" (UID: "23f385a3-7158-4868-a6e6-072696452b58") : secret "kserve-webhook-server-cert" not found
May 25 12:17:12.888006 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.887977    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-data\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.890107 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.890090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-cert\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:12.896160 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.896089    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjf9n\" (UniqueName: \"kubernetes.io/projected/082adc48-7102-4f6f-b0e5-36bf33bcd8fe-kube-api-access-sjf9n\") pod \"seaweedfs-79f457656b-47t5x\" (UID: \"082adc48-7102-4f6f-b0e5-36bf33bcd8fe\") " pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:12.896555 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.896523    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnfs\" (UniqueName: \"kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:12.896697 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:12.896676    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpx4\" (UniqueName: \"kubernetes.io/projected/06699cb6-41a3-4b18-8525-6ea93ef1d6c9-kube-api-access-qfpx4\") pod \"llmisvc-controller-manager-6b94ff949c-g2ss7\" (UID: \"06699cb6-41a3-4b18-8525-6ea93ef1d6c9\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:13.050732 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.050699    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:13.080439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.080403    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:13.197032 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.196968    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"]
May 25 12:17:13.199334 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:17:13.199295    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06699cb6_41a3_4b18_8525_6ea93ef1d6c9.slice/crio-826ab8bec4c43db5515d5bdde258222cb58e4180af11a979398c134bd225caf9 WatchSource:0}: Error finding container 826ab8bec4c43db5515d5bdde258222cb58e4180af11a979398c134bd225caf9: Status 404 returned error can't find the container with id 826ab8bec4c43db5515d5bdde258222cb58e4180af11a979398c134bd225caf9
May 25 12:17:13.200659 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.200643    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:17:13.224345 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.224320    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-47t5x"]
May 25 12:17:13.226684 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:17:13.226649    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082adc48_7102_4f6f_b0e5_36bf33bcd8fe.slice/crio-d318e9ee287ffd772e41baa05735ee5534c97ab9f8958bd4a320e68a5dc6d813 WatchSource:0}: Error finding container d318e9ee287ffd772e41baa05735ee5534c97ab9f8958bd4a320e68a5dc6d813: Status 404 returned error can't find the container with id d318e9ee287ffd772e41baa05735ee5534c97ab9f8958bd4a320e68a5dc6d813
May 25 12:17:13.326155 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.326050    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7" event={"ID":"06699cb6-41a3-4b18-8525-6ea93ef1d6c9","Type":"ContainerStarted","Data":"826ab8bec4c43db5515d5bdde258222cb58e4180af11a979398c134bd225caf9"}
May 25 12:17:13.327131 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.327105    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-47t5x" event={"ID":"082adc48-7102-4f6f-b0e5-36bf33bcd8fe","Type":"ContainerStarted","Data":"d318e9ee287ffd772e41baa05735ee5534c97ab9f8958bd4a320e68a5dc6d813"}
May 25 12:17:13.392968 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.392936    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:13.395334 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.395310    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") pod \"kserve-controller-manager-6768985688-dzrzf\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") " pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:13.640862 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.640771    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:13.792689 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:13.792655    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:13.797438 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:17:13.797408    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f385a3_7158_4868_a6e6_072696452b58.slice/crio-74c82773e4052bbde51941cb0c1750d880dc98a8f1dca76219e1a3e744b36c61 WatchSource:0}: Error finding container 74c82773e4052bbde51941cb0c1750d880dc98a8f1dca76219e1a3e744b36c61: Status 404 returned error can't find the container with id 74c82773e4052bbde51941cb0c1750d880dc98a8f1dca76219e1a3e744b36c61
May 25 12:17:14.335090 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:14.335047    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6768985688-dzrzf" event={"ID":"23f385a3-7158-4868-a6e6-072696452b58","Type":"ContainerStarted","Data":"74c82773e4052bbde51941cb0c1750d880dc98a8f1dca76219e1a3e744b36c61"}
May 25 12:17:19.357551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.357504    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6768985688-dzrzf" event={"ID":"23f385a3-7158-4868-a6e6-072696452b58","Type":"ContainerStarted","Data":"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"}
May 25 12:17:19.358025 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.357605    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:19.358930 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.358904    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7" event={"ID":"06699cb6-41a3-4b18-8525-6ea93ef1d6c9","Type":"ContainerStarted","Data":"6c51028d866acd73aff6dd17c83570a5d27859e24772bf216517d1e4dbdfb6e1"}
May 25 12:17:19.359065 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.358953    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:19.360337 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.360309    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-47t5x" event={"ID":"082adc48-7102-4f6f-b0e5-36bf33bcd8fe","Type":"ContainerStarted","Data":"13283945ceb43c37de7fa2c187895098e816a8a5f23ca8b41efae40e3d1acbeb"}
May 25 12:17:19.360473 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.360454    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:19.380361 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.380305    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6768985688-dzrzf" podStartSLOduration=2.950607562 podStartE2EDuration="7.380287496s" podCreationTimestamp="2026-05-25 12:17:12 +0000 UTC" firstStartedPulling="2026-05-25 12:17:13.799260225 +0000 UTC m=+303.144521068" lastFinishedPulling="2026-05-25 12:17:18.228940171 +0000 UTC m=+307.574201002" observedRunningTime="2026-05-25 12:17:19.378085205 +0000 UTC m=+308.723346059" watchObservedRunningTime="2026-05-25 12:17:19.380287496 +0000 UTC m=+308.725548373"
May 25 12:17:19.394103 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.394051    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7" podStartSLOduration=2.282334232 podStartE2EDuration="7.394036036s" podCreationTimestamp="2026-05-25 12:17:12 +0000 UTC" firstStartedPulling="2026-05-25 12:17:13.200772622 +0000 UTC m=+302.546033454" lastFinishedPulling="2026-05-25 12:17:18.312474411 +0000 UTC m=+307.657735258" observedRunningTime="2026-05-25 12:17:19.392960664 +0000 UTC m=+308.738221516" watchObservedRunningTime="2026-05-25 12:17:19.394036036 +0000 UTC m=+308.739296924"
May 25 12:17:19.408931 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:19.408873    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-47t5x" podStartSLOduration=2.270896284 podStartE2EDuration="7.408853301s" podCreationTimestamp="2026-05-25 12:17:12 +0000 UTC" firstStartedPulling="2026-05-25 12:17:13.228017678 +0000 UTC m=+302.573278513" lastFinishedPulling="2026-05-25 12:17:18.365974699 +0000 UTC m=+307.711235530" observedRunningTime="2026-05-25 12:17:19.407662981 +0000 UTC m=+308.752923838" watchObservedRunningTime="2026-05-25 12:17:19.408853301 +0000 UTC m=+308.754114155"
May 25 12:17:25.367303 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:25.367271    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-47t5x"
May 25 12:17:50.366191 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:50.366098    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-g2ss7"
May 25 12:17:50.369329 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:50.369306    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:51.613454 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.613414    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:51.613937 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.613633    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6768985688-dzrzf" podUID="23f385a3-7158-4868-a6e6-072696452b58" containerName="manager" containerID="cri-o://6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18" gracePeriod=10
May 25 12:17:51.854178 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.854153    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:51.940674 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.940574    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") pod \"23f385a3-7158-4868-a6e6-072696452b58\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") "
May 25 12:17:51.940843 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.940709    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hnfs\" (UniqueName: \"kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs\") pod \"23f385a3-7158-4868-a6e6-072696452b58\" (UID: \"23f385a3-7158-4868-a6e6-072696452b58\") "
May 25 12:17:51.942811 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.942784    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs" (OuterVolumeSpecName: "kube-api-access-9hnfs") pod "23f385a3-7158-4868-a6e6-072696452b58" (UID: "23f385a3-7158-4868-a6e6-072696452b58"). InnerVolumeSpecName "kube-api-access-9hnfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:17:51.942915 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:51.942830    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert" (OuterVolumeSpecName: "cert") pod "23f385a3-7158-4868-a6e6-072696452b58" (UID: "23f385a3-7158-4868-a6e6-072696452b58"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:17:52.041761 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.041720    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hnfs\" (UniqueName: \"kubernetes.io/projected/23f385a3-7158-4868-a6e6-072696452b58-kube-api-access-9hnfs\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:17:52.041761 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.041754    2575 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23f385a3-7158-4868-a6e6-072696452b58-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:17:52.474513 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.474479    2575 generic.go:358] "Generic (PLEG): container finished" podID="23f385a3-7158-4868-a6e6-072696452b58" containerID="6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18" exitCode=0
May 25 12:17:52.474702 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.474539    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6768985688-dzrzf"
May 25 12:17:52.474702 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.474553    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6768985688-dzrzf" event={"ID":"23f385a3-7158-4868-a6e6-072696452b58","Type":"ContainerDied","Data":"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"}
May 25 12:17:52.474702 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.474580    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6768985688-dzrzf" event={"ID":"23f385a3-7158-4868-a6e6-072696452b58","Type":"ContainerDied","Data":"74c82773e4052bbde51941cb0c1750d880dc98a8f1dca76219e1a3e744b36c61"}
May 25 12:17:52.474702 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.474594    2575 scope.go:117] "RemoveContainer" containerID="6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"
May 25 12:17:52.482771 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.482747    2575 scope.go:117] "RemoveContainer" containerID="6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"
May 25 12:17:52.483041 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:17:52.483023    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18\": container with ID starting with 6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18 not found: ID does not exist" containerID="6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"
May 25 12:17:52.483100 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.483053    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18"} err="failed to get container status \"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18\": rpc error: code = NotFound desc = could not find container \"6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18\": container with ID starting with 6116df3bfeafee62ae4d8e132a25f08cb85df3c99a0e31b0da7079c4301cfb18 not found: ID does not exist"
May 25 12:17:52.494645 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.494616    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:52.497364 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:52.497342    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6768985688-dzrzf"]
May 25 12:17:53.226683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:17:53.226645    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f385a3-7158-4868-a6e6-072696452b58" path="/var/lib/kubelet/pods/23f385a3-7158-4868-a6e6-072696452b58/volumes"
May 25 12:18:26.617624 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.617589    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-mjdzz"]
May 25 12:18:26.618136 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.617968    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f385a3-7158-4868-a6e6-072696452b58" containerName="manager"
May 25 12:18:26.618136 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.617984    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f385a3-7158-4868-a6e6-072696452b58" containerName="manager"
May 25 12:18:26.618253 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.618168    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="23f385a3-7158-4868-a6e6-072696452b58" containerName="manager"
May 25 12:18:26.621146 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.621130    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:26.622669 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.622644    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
May 25 12:18:26.622798 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.622713    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-nk669\""
May 25 12:18:26.629872 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.629846    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-696fc77849-bmj7w"]
May 25 12:18:26.633169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.633145    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-mjdzz"]
May 25 12:18:26.633321 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.633305    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.635303 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.635281    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
May 25 12:18:26.635402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.635381    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-k7zlr\""
May 25 12:18:26.640756 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.640730    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-bmj7w"]
May 25 12:18:26.697156 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.697104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.697351 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.697180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td2b9\" (UniqueName: \"kubernetes.io/projected/f71d71f2-9198-421e-ab40-89015ec835a2-kube-api-access-td2b9\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.697351 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.697239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxdx\" (UniqueName: \"kubernetes.io/projected/38366549-388f-48ce-9841-96e90748813b-kube-api-access-snxdx\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:26.697351 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.697282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:26.798579 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.798535    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.798773 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.798595    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-td2b9\" (UniqueName: \"kubernetes.io/projected/f71d71f2-9198-421e-ab40-89015ec835a2-kube-api-access-td2b9\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.798773 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.798622    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snxdx\" (UniqueName: \"kubernetes.io/projected/38366549-388f-48ce-9841-96e90748813b-kube-api-access-snxdx\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:26.798773 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.798652    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:26.798773 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:18:26.798700    2575 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 25 12:18:26.798773 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:18:26.798755    2575 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
May 25 12:18:26.798947 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:18:26.798794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert podName:f71d71f2-9198-421e-ab40-89015ec835a2 nodeName:}" failed. No retries permitted until 2026-05-25 12:18:27.298773801 +0000 UTC m=+376.644034650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert") pod "odh-model-controller-696fc77849-bmj7w" (UID: "f71d71f2-9198-421e-ab40-89015ec835a2") : secret "odh-model-controller-webhook-cert" not found
May 25 12:18:26.798947 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:18:26.798815    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs podName:38366549-388f-48ce-9841-96e90748813b nodeName:}" failed. No retries permitted until 2026-05-25 12:18:27.298805682 +0000 UTC m=+376.644066513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs") pod "model-serving-api-86f7b4b499-mjdzz" (UID: "38366549-388f-48ce-9841-96e90748813b") : secret "model-serving-api-tls" not found
May 25 12:18:26.807340 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.807307    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td2b9\" (UniqueName: \"kubernetes.io/projected/f71d71f2-9198-421e-ab40-89015ec835a2-kube-api-access-td2b9\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:26.807471 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:26.807375    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxdx\" (UniqueName: \"kubernetes.io/projected/38366549-388f-48ce-9841-96e90748813b-kube-api-access-snxdx\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:27.302861 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.302818    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:27.303065 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.302893    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:27.305306 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.305275    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366549-388f-48ce-9841-96e90748813b-tls-certs\") pod \"model-serving-api-86f7b4b499-mjdzz\" (UID: \"38366549-388f-48ce-9841-96e90748813b\") " pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:27.305431 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.305348    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f71d71f2-9198-421e-ab40-89015ec835a2-cert\") pod \"odh-model-controller-696fc77849-bmj7w\" (UID: \"f71d71f2-9198-421e-ab40-89015ec835a2\") " pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:27.533052 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.533008    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:27.543890 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.543864    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:27.678245 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.678211    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-mjdzz"]
May 25 12:18:27.683308 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:18:27.683270    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38366549_388f_48ce_9841_96e90748813b.slice/crio-09d73000fdba4e42c6ca3dc82ce9267fe0e13ced1d517f5bf6cba3aecca24ad3 WatchSource:0}: Error finding container 09d73000fdba4e42c6ca3dc82ce9267fe0e13ced1d517f5bf6cba3aecca24ad3: Status 404 returned error can't find the container with id 09d73000fdba4e42c6ca3dc82ce9267fe0e13ced1d517f5bf6cba3aecca24ad3
May 25 12:18:27.700596 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:27.700496    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-bmj7w"]
May 25 12:18:27.703005 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:18:27.702977    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71d71f2_9198_421e_ab40_89015ec835a2.slice/crio-897b168f9ebf2c49a62d3bb798a6def732585b7f817af47c4c20625b7a819224 WatchSource:0}: Error finding container 897b168f9ebf2c49a62d3bb798a6def732585b7f817af47c4c20625b7a819224: Status 404 returned error can't find the container with id 897b168f9ebf2c49a62d3bb798a6def732585b7f817af47c4c20625b7a819224
May 25 12:18:28.608102 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:28.608053    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-mjdzz" event={"ID":"38366549-388f-48ce-9841-96e90748813b","Type":"ContainerStarted","Data":"09d73000fdba4e42c6ca3dc82ce9267fe0e13ced1d517f5bf6cba3aecca24ad3"}
May 25 12:18:28.609778 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:28.609722    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-bmj7w" event={"ID":"f71d71f2-9198-421e-ab40-89015ec835a2","Type":"ContainerStarted","Data":"897b168f9ebf2c49a62d3bb798a6def732585b7f817af47c4c20625b7a819224"}
May 25 12:18:31.624448 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.624408    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-mjdzz" event={"ID":"38366549-388f-48ce-9841-96e90748813b","Type":"ContainerStarted","Data":"f2c85792db56225aa5101e8a8a9bb477181c087b633de56f63de44642849d822"}
May 25 12:18:31.624921 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.624508    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:18:31.625774 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.625748    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-bmj7w" event={"ID":"f71d71f2-9198-421e-ab40-89015ec835a2","Type":"ContainerStarted","Data":"1a152a3a75ae09325c24fdbae07372bf526d27ceca48a4023bc936bfaa185387"}
May 25 12:18:31.625903 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.625866    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:31.640439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.640391    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-mjdzz" podStartSLOduration=1.865994063 podStartE2EDuration="5.640377429s" podCreationTimestamp="2026-05-25 12:18:26 +0000 UTC" firstStartedPulling="2026-05-25 12:18:27.685723746 +0000 UTC m=+377.030984578" lastFinishedPulling="2026-05-25 12:18:31.460107108 +0000 UTC m=+380.805367944" observedRunningTime="2026-05-25 12:18:31.639160177 +0000 UTC m=+380.984421030" watchObservedRunningTime="2026-05-25 12:18:31.640377429 +0000 UTC m=+380.985638295"
May 25 12:18:31.654487 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:31.654424    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/odh-model-controller-696fc77849-bmj7w" podStartSLOduration=1.89386871 podStartE2EDuration="5.65440843s" podCreationTimestamp="2026-05-25 12:18:26 +0000 UTC" firstStartedPulling="2026-05-25 12:18:27.704321268 +0000 UTC m=+377.049582102" lastFinishedPulling="2026-05-25 12:18:31.464860992 +0000 UTC m=+380.810121822" observedRunningTime="2026-05-25 12:18:31.65287848 +0000 UTC m=+380.998139336" watchObservedRunningTime="2026-05-25 12:18:31.65440843 +0000 UTC m=+380.999669284"
May 25 12:18:42.632221 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:42.632172    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-696fc77849-bmj7w"
May 25 12:18:42.634456 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:18:42.634433    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-mjdzz"
May 25 12:19:18.984551 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:18.984511    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6748bccc5c-4khsg"]
May 25 12:19:18.990667 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:18.990638    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:18.996625 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:18.996599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6748bccc5c-4khsg"]
May 25 12:19:19.053996 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.053948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-oauth-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-oauth-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-service-ca\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsd5r\" (UniqueName: \"kubernetes.io/projected/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-kube-api-access-hsd5r\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.054402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.054251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-trusted-ca-bundle\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.155405 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.155365    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-oauth-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.155606 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.155415    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-service-ca\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.155606 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.155514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsd5r\" (UniqueName: \"kubernetes.io/projected/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-kube-api-access-hsd5r\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.155606 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.155549    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-trusted-ca-bundle\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.155606 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.155581    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-oauth-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156178 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156151    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-service-ca\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156334 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156306    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-oauth-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156398 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156382    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156457 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156422    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156513 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156465    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-trusted-ca-bundle\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.156896 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.156874    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.157985 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.157954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-oauth-config\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.158769 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.158750    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-console-serving-cert\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.162780 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.162760    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsd5r\" (UniqueName: \"kubernetes.io/projected/d0f38253-3a7c-4ba3-891b-a6a66c3b5f54-kube-api-access-hsd5r\") pod \"console-6748bccc5c-4khsg\" (UID: \"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54\") " pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.301073 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.301038    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:19.447051 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.440483    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6748bccc5c-4khsg"]
May 25 12:19:19.797889 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.797855    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6748bccc5c-4khsg" event={"ID":"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54","Type":"ContainerStarted","Data":"52c8b5c6589bac905f6f979952f7a166f90d97864d6ea244d02666a232b57ddd"}
May 25 12:19:19.798055 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.797894    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6748bccc5c-4khsg" event={"ID":"d0f38253-3a7c-4ba3-891b-a6a66c3b5f54","Type":"ContainerStarted","Data":"118339d232243e972fbffc83f235012a7a2f91e730ffedd1822af6607fb32687"}
May 25 12:19:19.816103 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:19.816050    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6748bccc5c-4khsg" podStartSLOduration=1.816033757 podStartE2EDuration="1.816033757s" podCreationTimestamp="2026-05-25 12:19:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:19:19.813164551 +0000 UTC m=+429.158425407" watchObservedRunningTime="2026-05-25 12:19:19.816033757 +0000 UTC m=+429.161294609"
May 25 12:19:29.301763 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:29.301715    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:29.302251 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:29.301857    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:29.306670 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:29.306646    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:29.838553 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:29.838524    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6748bccc5c-4khsg"
May 25 12:19:29.886155 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:29.886111    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:19:54.909918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:54.909851    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b4b564c6f-kbvc7" podUID="a07998e5-1576-4b97-90af-20bd334874e6" containerName="console" containerID="cri-o://8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01" gracePeriod=15
May 25 12:19:55.153099 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.153075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4b564c6f-kbvc7_a07998e5-1576-4b97-90af-20bd334874e6/console/0.log"
May 25 12:19:55.153250 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.153142    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:19:55.276887 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276783    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.276887 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276844    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.276887 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276879    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.277169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276895    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.277169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276911    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dll99\" (UniqueName: \"kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.277169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.276948    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.277169 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.277139    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle\") pod \"a07998e5-1576-4b97-90af-20bd334874e6\" (UID: \"a07998e5-1576-4b97-90af-20bd334874e6\") "
May 25 12:19:55.277497 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.277471    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:19:55.277680 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.277498    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config" (OuterVolumeSpecName: "console-config") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:19:55.277680 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.277541    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:19:55.277680 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.277626    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:19:55.279348 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.279310    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:19:55.279348 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.279322    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:19:55.279462 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.279410    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99" (OuterVolumeSpecName: "kube-api-access-dll99") pod "a07998e5-1576-4b97-90af-20bd334874e6" (UID: "a07998e5-1576-4b97-90af-20bd334874e6"). InnerVolumeSpecName "kube-api-access-dll99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:19:55.379000 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.378965    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-console-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379000 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379000    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379016    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-oauth-serving-cert\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379031    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-service-ca\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379046    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dll99\" (UniqueName: \"kubernetes.io/projected/a07998e5-1576-4b97-90af-20bd334874e6-kube-api-access-dll99\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379061    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a07998e5-1576-4b97-90af-20bd334874e6-console-oauth-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.379216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.379077    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07998e5-1576-4b97-90af-20bd334874e6-trusted-ca-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:19:55.938984 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.938955    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4b564c6f-kbvc7_a07998e5-1576-4b97-90af-20bd334874e6/console/0.log"
May 25 12:19:55.939465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.938997    2575 generic.go:358] "Generic (PLEG): container finished" podID="a07998e5-1576-4b97-90af-20bd334874e6" containerID="8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01" exitCode=2
May 25 12:19:55.939465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.939063    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b564c6f-kbvc7" event={"ID":"a07998e5-1576-4b97-90af-20bd334874e6","Type":"ContainerDied","Data":"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"}
May 25 12:19:55.939465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.939089    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b564c6f-kbvc7" event={"ID":"a07998e5-1576-4b97-90af-20bd334874e6","Type":"ContainerDied","Data":"ef2b0566e430056b625e46952d4155a21034bcc5ccbebdcce15eafc7626e31b0"}
May 25 12:19:55.939465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.939084    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b564c6f-kbvc7"
May 25 12:19:55.939465 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.939159    2575 scope.go:117] "RemoveContainer" containerID="8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"
May 25 12:19:55.947899 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.947874    2575 scope.go:117] "RemoveContainer" containerID="8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"
May 25 12:19:55.948150 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:19:55.948129    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01\": container with ID starting with 8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01 not found: ID does not exist" containerID="8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"
May 25 12:19:55.948219 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.948159    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01"} err="failed to get container status \"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01\": rpc error: code = NotFound desc = could not find container \"8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01\": container with ID starting with 8f5cd18da93eb222fc9023570585fded4e3c425437ed81f290dd1c3038594f01 not found: ID does not exist"
May 25 12:19:55.961915 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.961878    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:19:55.965279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:55.965254    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4b564c6f-kbvc7"]
May 25 12:19:57.220822 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:19:57.220786    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07998e5-1576-4b97-90af-20bd334874e6" path="/var/lib/kubelet/pods/a07998e5-1576-4b97-90af-20bd334874e6/volumes"
May 25 12:22:11.195749 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:11.195717    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:22:11.196343 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:11.195953    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:22:28.357293 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.357259    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:22:28.359648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.357629    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07998e5-1576-4b97-90af-20bd334874e6" containerName="console"
May 25 12:22:28.359648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.357640    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07998e5-1576-4b97-90af-20bd334874e6" containerName="console"
May 25 12:22:28.359648 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.357691    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a07998e5-1576-4b97-90af-20bd334874e6" containerName="console"
May 25 12:22:28.360560 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.360544    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.362495 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.362469    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 12:22:28.362608 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.362471    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a7098-kube-rbac-proxy-sar-config\""
May 25 12:22:28.362608 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.362474    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a7098-serving-cert\""
May 25 12:22:28.362608 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.362531    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-79bgq\""
May 25 12:22:28.366833 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.366810    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:22:28.512407 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.512375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.512591 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.512418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.612911 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.612813    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.612911 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.612875    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.613633 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.613606    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.615271 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.615249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls\") pod \"model-chainer-raw-a7098-774f676bb5-nwgj4\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") " pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.671380 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.671338    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:28.805127 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.805094    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:22:28.808806 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:22:28.808778    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e499336_e0b4_4cc3_ad25_cb2c94d3baf9.slice/crio-c1fc634e45d00a8c2d82ee5dc4997f865d4a8320feea6062fd3c7b02ec5586dc WatchSource:0}: Error finding container c1fc634e45d00a8c2d82ee5dc4997f865d4a8320feea6062fd3c7b02ec5586dc: Status 404 returned error can't find the container with id c1fc634e45d00a8c2d82ee5dc4997f865d4a8320feea6062fd3c7b02ec5586dc
May 25 12:22:28.810645 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:28.810626    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:22:29.485170 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:29.485132    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" event={"ID":"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9","Type":"ContainerStarted","Data":"c1fc634e45d00a8c2d82ee5dc4997f865d4a8320feea6062fd3c7b02ec5586dc"}
May 25 12:22:31.497220 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:31.497158    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" event={"ID":"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9","Type":"ContainerStarted","Data":"14336b3d24cfcddc26a44015d1d5adcecd431d98c517182779ecd32b2a9c461c"}
May 25 12:22:31.497718 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:31.497358    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:31.512366 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:31.512314    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podStartSLOduration=1.8204643169999999 podStartE2EDuration="3.512301193s" podCreationTimestamp="2026-05-25 12:22:28 +0000 UTC" firstStartedPulling="2026-05-25 12:22:28.810814459 +0000 UTC m=+618.156075304" lastFinishedPulling="2026-05-25 12:22:30.502651335 +0000 UTC m=+619.847912180" observedRunningTime="2026-05-25 12:22:31.510862658 +0000 UTC m=+620.856123511" watchObservedRunningTime="2026-05-25 12:22:31.512301193 +0000 UTC m=+620.857562076"
May 25 12:22:37.506588 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:37.506555    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:38.423066 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:38.423031    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:22:38.423332 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:38.423308    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" containerID="cri-o://14336b3d24cfcddc26a44015d1d5adcecd431d98c517182779ecd32b2a9c461c" gracePeriod=30
May 25 12:22:42.504685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:42.504636    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:22:47.505030 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:47.504990    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:22:52.505066 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:52.505022    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:22:52.505591 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:52.505126    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:22:57.505564 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:22:57.505524    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:23:02.504439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:02.504401    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:23:07.504898 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:07.504857    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:23:08.625770 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:08.625730    2575 generic.go:358] "Generic (PLEG): container finished" podID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerID="14336b3d24cfcddc26a44015d1d5adcecd431d98c517182779ecd32b2a9c461c" exitCode=0
May 25 12:23:08.625770 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:08.625774    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" event={"ID":"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9","Type":"ContainerDied","Data":"14336b3d24cfcddc26a44015d1d5adcecd431d98c517182779ecd32b2a9c461c"}
May 25 12:23:09.077335 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.077309    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:23:09.178114 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.178055    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls\") pod \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") "
May 25 12:23:09.178349 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.178236    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle\") pod \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\" (UID: \"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9\") "
May 25 12:23:09.178570 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.178544    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" (UID: "0e499336-e0b4-4cc3-ad25-cb2c94d3baf9"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:23:09.180394 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.180374    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" (UID: "0e499336-e0b4-4cc3-ad25-cb2c94d3baf9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:23:09.279346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.279295    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-openshift-service-ca-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:23:09.279346 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.279343    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9-proxy-tls\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:23:09.630033 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.630001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4" event={"ID":"0e499336-e0b4-4cc3-ad25-cb2c94d3baf9","Type":"ContainerDied","Data":"c1fc634e45d00a8c2d82ee5dc4997f865d4a8320feea6062fd3c7b02ec5586dc"}
May 25 12:23:09.630538 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.630047    2575 scope.go:117] "RemoveContainer" containerID="14336b3d24cfcddc26a44015d1d5adcecd431d98c517182779ecd32b2a9c461c"
May 25 12:23:09.630538 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.630051    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"
May 25 12:23:09.648014 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.647988    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:23:09.655433 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:09.655406    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a7098-774f676bb5-nwgj4"]
May 25 12:23:11.221129 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:23:11.220954    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" path="/var/lib/kubelet/pods/0e499336-e0b4-4cc3-ad25-cb2c94d3baf9/volumes"
May 25 12:24:08.749956 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.749870    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:08.750517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.750314    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098"
May 25 12:24:08.750517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.750328    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098"
May 25 12:24:08.750517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.750388    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e499336-e0b4-4cc3-ad25-cb2c94d3baf9" containerName="model-chainer-raw-a7098"
May 25 12:24:08.753432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.753410    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:08.755511 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.755485    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-79bgq\""
May 25 12:24:08.755511 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.755510    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 12:24:08.755711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.755492    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-94e63-serving-cert\""
May 25 12:24:08.755711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.755492    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-94e63-kube-rbac-proxy-sar-config\""
May 25 12:24:08.764781 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.764758    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:08.889290 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.889241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:08.889506 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.889382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:08.990125 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.990085    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:08.990331 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.990152    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:08.990331 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:24:08.990275    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-serving-cert: secret "model-chainer-raw-hpa-94e63-serving-cert" not found
May 25 12:24:08.990331 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:24:08.990329    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls podName:513eae0c-4806-472d-94d6-0785c7bc2f04 nodeName:}" failed. No retries permitted until 2026-05-25 12:24:09.490313642 +0000 UTC m=+718.835574473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls") pod "model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" (UID: "513eae0c-4806-472d-94d6-0785c7bc2f04") : secret "model-chainer-raw-hpa-94e63-serving-cert" not found
May 25 12:24:08.990903 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:08.990873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:09.494414 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:09.494371    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:09.496970 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:09.496934    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") pod \"model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:09.663823 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:09.663767    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:09.794586 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:09.794561    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:09.849162 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:09.849123    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" event={"ID":"513eae0c-4806-472d-94d6-0785c7bc2f04","Type":"ContainerStarted","Data":"6230caba81ccc8094d7ac82ca2b4d84d611421298b5d27dcb289001e3f760e00"}
May 25 12:24:10.854687 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:10.854646    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" event={"ID":"513eae0c-4806-472d-94d6-0785c7bc2f04","Type":"ContainerStarted","Data":"515d9e521716011edf407cfc39a82f505326da25861dd06c1c94639ea2f853be"}
May 25 12:24:10.855084 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:10.854747    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:10.876530 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:10.876475    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podStartSLOduration=2.8764606710000002 podStartE2EDuration="2.876460671s" podCreationTimestamp="2026-05-25 12:24:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:24:10.874697884 +0000 UTC m=+720.219958739" watchObservedRunningTime="2026-05-25 12:24:10.876460671 +0000 UTC m=+720.221721522"
May 25 12:24:16.864735 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:16.864705    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:18.779320 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.779287    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:18.779741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.779498    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" containerID="cri-o://515d9e521716011edf407cfc39a82f505326da25861dd06c1c94639ea2f853be" gracePeriod=30
May 25 12:24:18.989061 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.989025    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:24:18.992811 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.992793    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:18.995251 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.995228    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-0f5ec-predictor-serving-cert\""
May 25 12:24:18.995383 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.995231    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\""
May 25 12:24:18.996044 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:18.996030    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 12:24:19.007514 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.007489    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:24:19.080176 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.080135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjh7r\" (UniqueName: \"kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.080361 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.080190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.080361 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.080267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.180743 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.180697    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.180940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.180780    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh7r\" (UniqueName: \"kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.180940 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.180816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.181397 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.181377    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.183271 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.183243    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.196161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.196136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjh7r\" (UniqueName: \"kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r\") pod \"message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") " pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.304271 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.304233    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:19.447406 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.447381    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:24:19.449992 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:24:19.449957    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a47ff3_a5a8_47d0_9984_c407390ba6e7.slice/crio-0ed9dbe080c72cf26dab80804353d5f3de51d65e8b302d0090fc0c75fbd5ea37 WatchSource:0}: Error finding container 0ed9dbe080c72cf26dab80804353d5f3de51d65e8b302d0090fc0c75fbd5ea37: Status 404 returned error can't find the container with id 0ed9dbe080c72cf26dab80804353d5f3de51d65e8b302d0090fc0c75fbd5ea37
May 25 12:24:19.888508 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:19.888473    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerStarted","Data":"0ed9dbe080c72cf26dab80804353d5f3de51d65e8b302d0090fc0c75fbd5ea37"}
May 25 12:24:20.893234 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:20.893180    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerStarted","Data":"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"}
May 25 12:24:21.863826 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:21.863779    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:23.904836 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:23.904797    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerStarted","Data":"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"}
May 25 12:24:23.905255 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:23.904901    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:23.922605 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:23.922552    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" podStartSLOduration=2.417339306 podStartE2EDuration="5.922537681s" podCreationTimestamp="2026-05-25 12:24:18 +0000 UTC" firstStartedPulling="2026-05-25 12:24:19.451769306 +0000 UTC m=+728.797030140" lastFinishedPulling="2026-05-25 12:24:22.956967684 +0000 UTC m=+732.302228515" observedRunningTime="2026-05-25 12:24:23.921478392 +0000 UTC m=+733.266739248" watchObservedRunningTime="2026-05-25 12:24:23.922537681 +0000 UTC m=+733.267798534"
May 25 12:24:24.908335 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:24.908302    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:24.910025 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:24.910004    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:26.862093 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:26.862053    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:31.864315 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:31.864275    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:31.864713 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:31.864379    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:31.921544 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:31.921515    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:24:36.862279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:36.862233    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:41.862616 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:41.862564    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:46.862372 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:46.862322    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:24:48.993762 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:48.993727    2575 generic.go:358] "Generic (PLEG): container finished" podID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerID="515d9e521716011edf407cfc39a82f505326da25861dd06c1c94639ea2f853be" exitCode=0
May 25 12:24:48.994161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:48.993801    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" event={"ID":"513eae0c-4806-472d-94d6-0785c7bc2f04","Type":"ContainerDied","Data":"515d9e521716011edf407cfc39a82f505326da25861dd06c1c94639ea2f853be"}
May 25 12:24:49.434077 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.434052    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:49.556268 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.556233    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle\") pod \"513eae0c-4806-472d-94d6-0785c7bc2f04\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") "
May 25 12:24:49.556453 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.556304    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") pod \"513eae0c-4806-472d-94d6-0785c7bc2f04\" (UID: \"513eae0c-4806-472d-94d6-0785c7bc2f04\") "
May 25 12:24:49.556683 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.556648    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "513eae0c-4806-472d-94d6-0785c7bc2f04" (UID: "513eae0c-4806-472d-94d6-0785c7bc2f04"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:24:49.558397 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.558378    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "513eae0c-4806-472d-94d6-0785c7bc2f04" (UID: "513eae0c-4806-472d-94d6-0785c7bc2f04"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:24:49.657225 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.657138    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/513eae0c-4806-472d-94d6-0785c7bc2f04-proxy-tls\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:24:49.657225 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.657186    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/513eae0c-4806-472d-94d6-0785c7bc2f04-openshift-service-ca-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:24:49.998233 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.998131    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68" event={"ID":"513eae0c-4806-472d-94d6-0785c7bc2f04","Type":"ContainerDied","Data":"6230caba81ccc8094d7ac82ca2b4d84d611421298b5d27dcb289001e3f760e00"}
May 25 12:24:49.998233 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.998158    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"
May 25 12:24:49.998233 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:49.998188    2575 scope.go:117] "RemoveContainer" containerID="515d9e521716011edf407cfc39a82f505326da25861dd06c1c94639ea2f853be"
May 25 12:24:50.020711 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:50.020684    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:50.026281 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:50.026255    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-94e63-7b95ddf9d9-nwg68"]
May 25 12:24:51.222093 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:24:51.222056    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" path="/var/lib/kubelet/pods/513eae0c-4806-472d-94d6-0785c7bc2f04/volumes"
May 25 12:26:04.035484 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.035450    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6_03a47ff3-a5a8-47d0-9984-c407390ba6e7/kserve-container/0.log"
May 25 12:26:04.337499 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.337464    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:26:04.337799 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.337756    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kserve-container" containerID="cri-o://d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b" gracePeriod=30
May 25 12:26:04.337883 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.337791    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kube-rbac-proxy" containerID="cri-o://c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba" gracePeriod=30
May 25 12:26:04.592439 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.592361    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:26:04.722787 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.722743    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjh7r\" (UniqueName: \"kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r\") pod \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") "
May 25 12:26:04.722787 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.722792    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\") pod \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") "
May 25 12:26:04.723116 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.722835    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls\") pod \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\" (UID: \"03a47ff3-a5a8-47d0-9984-c407390ba6e7\") "
May 25 12:26:04.723261 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.723193    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config") pod "03a47ff3-a5a8-47d0-9984-c407390ba6e7" (UID: "03a47ff3-a5a8-47d0-9984-c407390ba6e7"). InnerVolumeSpecName "message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:26:04.725005 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.724979    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r" (OuterVolumeSpecName: "kube-api-access-zjh7r") pod "03a47ff3-a5a8-47d0-9984-c407390ba6e7" (UID: "03a47ff3-a5a8-47d0-9984-c407390ba6e7"). InnerVolumeSpecName "kube-api-access-zjh7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:26:04.725099 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.725015    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "03a47ff3-a5a8-47d0-9984-c407390ba6e7" (UID: "03a47ff3-a5a8-47d0-9984-c407390ba6e7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:26:04.824639 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.824588    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjh7r\" (UniqueName: \"kubernetes.io/projected/03a47ff3-a5a8-47d0-9984-c407390ba6e7-kube-api-access-zjh7r\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:26:04.824639 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.824636    2575 reconciler_common.go:299] "Volume detached for volume \"message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03a47ff3-a5a8-47d0-9984-c407390ba6e7-message-dumper-raw-0f5ec-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:26:04.824639 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:04.824648    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03a47ff3-a5a8-47d0-9984-c407390ba6e7-proxy-tls\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:26:05.260913 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.260876    2575 generic.go:358] "Generic (PLEG): container finished" podID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerID="c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba" exitCode=2
May 25 12:26:05.260913 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.260905    2575 generic.go:358] "Generic (PLEG): container finished" podID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerID="d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b" exitCode=2
May 25 12:26:05.261412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.260958    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerDied","Data":"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"}
May 25 12:26:05.261412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.260992    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerDied","Data":"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"}
May 25 12:26:05.261412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.261006    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6" event={"ID":"03a47ff3-a5a8-47d0-9984-c407390ba6e7","Type":"ContainerDied","Data":"0ed9dbe080c72cf26dab80804353d5f3de51d65e8b302d0090fc0c75fbd5ea37"}
May 25 12:26:05.261412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.260965    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"
May 25 12:26:05.261412 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.261023    2575 scope.go:117] "RemoveContainer" containerID="c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"
May 25 12:26:05.274167 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.274144    2575 scope.go:117] "RemoveContainer" containerID="d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"
May 25 12:26:05.281158 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.281131    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:26:05.282082 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.282064    2575 scope.go:117] "RemoveContainer" containerID="c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"
May 25 12:26:05.282396 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:26:05.282376    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba\": container with ID starting with c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba not found: ID does not exist" containerID="c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"
May 25 12:26:05.282475 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.282414    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"} err="failed to get container status \"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba\": rpc error: code = NotFound desc = could not find container \"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba\": container with ID starting with c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba not found: ID does not exist"
May 25 12:26:05.282475 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.282436    2575 scope.go:117] "RemoveContainer" containerID="d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"
May 25 12:26:05.282696 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:26:05.282668    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b\": container with ID starting with d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b not found: ID does not exist" containerID="d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"
May 25 12:26:05.282752 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.282706    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"} err="failed to get container status \"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b\": rpc error: code = NotFound desc = could not find container \"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b\": container with ID starting with d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b not found: ID does not exist"
May 25 12:26:05.282752 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.282732    2575 scope.go:117] "RemoveContainer" containerID="c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"
May 25 12:26:05.283146 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.283092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba"} err="failed to get container status \"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba\": rpc error: code = NotFound desc = could not find container \"c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba\": container with ID starting with c28ffff7c14b06d1909afaf4d7f1c909cadd6c8c55e283804ec47ab5ed36d3ba not found: ID does not exist"
May 25 12:26:05.283146 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.283125    2575 scope.go:117] "RemoveContainer" containerID="d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"
May 25 12:26:05.283568 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.283539    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b"} err="failed to get container status \"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b\": rpc error: code = NotFound desc = could not find container \"d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b\": container with ID starting with d26f6284e9dfc83d4ff94d03fd9096c2ce2e002724563c5c1ac62ecc94a2272b not found: ID does not exist"
May 25 12:26:05.285228 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:05.285190    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-0f5ec-predictor-566f7456bf-5v6j6"]
May 25 12:26:07.220593 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:26:07.220556    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" path="/var/lib/kubelet/pods/03a47ff3-a5a8-47d0-9984-c407390ba6e7/volumes"
May 25 12:27:11.220765 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:27:11.220677    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:27:11.224043 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:27:11.224024    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:32:11.249660 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:32:11.249630    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:32:11.253717 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:32:11.253696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:33:04.381226 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381127    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mctg8/must-gather-tg9lw"]
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381555    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kserve-container"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381569    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kserve-container"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381581    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kube-rbac-proxy"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381586    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kube-rbac-proxy"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381594    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381600    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381660    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="513eae0c-4806-472d-94d6-0785c7bc2f04" containerName="model-chainer-raw-hpa-94e63"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381669    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kserve-container"
May 25 12:33:04.381682 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.381674    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="03a47ff3-a5a8-47d0-9984-c407390ba6e7" containerName="kube-rbac-proxy"
May 25 12:33:04.384647 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.384628    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.386308 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.386285    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mctg8\"/\"kube-root-ca.crt\""
May 25 12:33:04.386646 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.386621    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mctg8\"/\"openshift-service-ca.crt\""
May 25 12:33:04.386741 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.386633    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mctg8\"/\"default-dockercfg-2b2hc\""
May 25 12:33:04.392501 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.392478    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mctg8/must-gather-tg9lw"]
May 25 12:33:04.497944 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.497903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhz5\" (UniqueName: \"kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.498134 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.498002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.598782 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.598737    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.598963 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.598849    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhz5\" (UniqueName: \"kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.599189 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.599168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.610160 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.610131    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhz5\" (UniqueName: \"kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5\") pod \"must-gather-tg9lw\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") " pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.701279 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.701170    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:04.832308 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.832267    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mctg8/must-gather-tg9lw"]
May 25 12:33:04.835511 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:33:04.835477    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ffd9bf2_560d_4c42_81e2_45f0185e3283.slice/crio-7ed049c19e88f2bfbf02c12d93f3a9d1bc4c2a334ca1c9ad36677650d6d826f9 WatchSource:0}: Error finding container 7ed049c19e88f2bfbf02c12d93f3a9d1bc4c2a334ca1c9ad36677650d6d826f9: Status 404 returned error can't find the container with id 7ed049c19e88f2bfbf02c12d93f3a9d1bc4c2a334ca1c9ad36677650d6d826f9
May 25 12:33:04.837257 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:04.837238    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:33:05.732026 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:05.731956    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctg8/must-gather-tg9lw" event={"ID":"1ffd9bf2-560d-4c42-81e2-45f0185e3283","Type":"ContainerStarted","Data":"7ed049c19e88f2bfbf02c12d93f3a9d1bc4c2a334ca1c9ad36677650d6d826f9"}
May 25 12:33:11.757634 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:11.757593    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctg8/must-gather-tg9lw" event={"ID":"1ffd9bf2-560d-4c42-81e2-45f0185e3283","Type":"ContainerStarted","Data":"5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9"}
May 25 12:33:11.757634 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:11.757638    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctg8/must-gather-tg9lw" event={"ID":"1ffd9bf2-560d-4c42-81e2-45f0185e3283","Type":"ContainerStarted","Data":"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"}
May 25 12:33:11.776146 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:11.776071    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mctg8/must-gather-tg9lw" podStartSLOduration=1.641395422 podStartE2EDuration="7.776051363s" podCreationTimestamp="2026-05-25 12:33:04 +0000 UTC" firstStartedPulling="2026-05-25 12:33:04.837366681 +0000 UTC m=+1254.182627512" lastFinishedPulling="2026-05-25 12:33:10.972022622 +0000 UTC m=+1260.317283453" observedRunningTime="2026-05-25 12:33:11.773061359 +0000 UTC m=+1261.118322213" watchObservedRunningTime="2026-05-25 12:33:11.776051363 +0000 UTC m=+1261.121312217"
May 25 12:33:31.834819 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:31.834781    2575 generic.go:358] "Generic (PLEG): container finished" podID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerID="9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d" exitCode=0
May 25 12:33:31.835268 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:31.834850    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctg8/must-gather-tg9lw" event={"ID":"1ffd9bf2-560d-4c42-81e2-45f0185e3283","Type":"ContainerDied","Data":"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"}
May 25 12:33:31.835268 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:31.835241    2575 scope.go:117] "RemoveContainer" containerID="9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"
May 25 12:33:32.741114 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:32.741078    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctg8_must-gather-tg9lw_1ffd9bf2-560d-4c42-81e2-45f0185e3283/gather/0.log"
May 25 12:33:35.951480 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:35.951448    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-46ctg_8d906ac4-0b05-447c-bd3a-8165bbb061ec/global-pull-secret-syncer/0.log"
May 25 12:33:36.134333 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:36.134303    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nh6sf_88e4d693-faf7-49f7-b034-008cb33581c6/konnectivity-agent/0.log"
May 25 12:33:36.194025 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:36.193993    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-54.ec2.internal_bda6a02b4c92a0b4e2cb4f871b9cfb7a/haproxy/0.log"
May 25 12:33:38.128629 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.128590    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mctg8/must-gather-tg9lw"]
May 25 12:33:38.129028 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.128826    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-mctg8/must-gather-tg9lw" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="copy" containerID="cri-o://5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9" gracePeriod=2
May 25 12:33:38.133353 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.133319    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mctg8/must-gather-tg9lw"]
May 25 12:33:38.364632 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.364607    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctg8_must-gather-tg9lw_1ffd9bf2-560d-4c42-81e2-45f0185e3283/copy/0.log"
May 25 12:33:38.364998 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.364981    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:38.366517 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.366494    2575 status_manager.go:895] "Failed to get status for pod" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" pod="openshift-must-gather-mctg8/must-gather-tg9lw" err="pods \"must-gather-tg9lw\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mctg8\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object"
May 25 12:33:38.526942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.526848    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dhz5\" (UniqueName: \"kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5\") pod \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") "
May 25 12:33:38.527105 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.526961    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output\") pod \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\" (UID: \"1ffd9bf2-560d-4c42-81e2-45f0185e3283\") "
May 25 12:33:38.527984 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.527959    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1ffd9bf2-560d-4c42-81e2-45f0185e3283" (UID: "1ffd9bf2-560d-4c42-81e2-45f0185e3283"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:33:38.529098 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.529077    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5" (OuterVolumeSpecName: "kube-api-access-9dhz5") pod "1ffd9bf2-560d-4c42-81e2-45f0185e3283" (UID: "1ffd9bf2-560d-4c42-81e2-45f0185e3283"). InnerVolumeSpecName "kube-api-access-9dhz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:33:38.627969 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.627924    2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1ffd9bf2-560d-4c42-81e2-45f0185e3283-must-gather-output\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:33:38.627969 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.627960    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhz5\" (UniqueName: \"kubernetes.io/projected/1ffd9bf2-560d-4c42-81e2-45f0185e3283-kube-api-access-9dhz5\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\""
May 25 12:33:38.865224 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.865172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctg8_must-gather-tg9lw_1ffd9bf2-560d-4c42-81e2-45f0185e3283/copy/0.log"
May 25 12:33:38.865513 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.865490    2575 generic.go:358] "Generic (PLEG): container finished" podID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerID="5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9" exitCode=143
May 25 12:33:38.865579 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.865547    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctg8/must-gather-tg9lw"
May 25 12:33:38.865619 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.865595    2575 scope.go:117] "RemoveContainer" containerID="5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9"
May 25 12:33:38.867571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.867544    2575 status_manager.go:895] "Failed to get status for pod" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" pod="openshift-must-gather-mctg8/must-gather-tg9lw" err="pods \"must-gather-tg9lw\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mctg8\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object"
May 25 12:33:38.873926 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.873909    2575 scope.go:117] "RemoveContainer" containerID="9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"
May 25 12:33:38.875504 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.875480    2575 status_manager.go:895] "Failed to get status for pod" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" pod="openshift-must-gather-mctg8/must-gather-tg9lw" err="pods \"must-gather-tg9lw\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mctg8\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object"
May 25 12:33:38.884703 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.884682    2575 scope.go:117] "RemoveContainer" containerID="5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9"
May 25 12:33:38.884994 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:33:38.884967    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9\": container with ID starting with 5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9 not found: ID does not exist" containerID="5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9"
May 25 12:33:38.885070 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.885007    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9"} err="failed to get container status \"5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9\": rpc error: code = NotFound desc = could not find container \"5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9\": container with ID starting with 5b6316387c8e665b8429cbb779db41e18055d2122394f6172928c41f407bb0b9 not found: ID does not exist"
May 25 12:33:38.885070 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.885034    2575 scope.go:117] "RemoveContainer" containerID="9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"
May 25 12:33:38.885342 ip-10-0-130-54 kubenswrapper[2575]: E0525 12:33:38.885323    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d\": container with ID starting with 9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d not found: ID does not exist" containerID="9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"
May 25 12:33:38.885398 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:38.885348    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d"} err="failed to get container status \"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d\": rpc error: code = NotFound desc = could not find container \"9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d\": container with ID starting with 9f011f8137b1cf2d446196b2c085225aa6aafcdffc1a32aa6547bc95583de55d not found: ID does not exist"
May 25 12:33:39.059299 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.059265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/alertmanager/0.log"
May 25 12:33:39.097402 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.097372    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/config-reloader/0.log"
May 25 12:33:39.126564 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.126478    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/kube-rbac-proxy-web/0.log"
May 25 12:33:39.167732 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.167693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/kube-rbac-proxy/0.log"
May 25 12:33:39.206270 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.206236    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/kube-rbac-proxy-metric/0.log"
May 25 12:33:39.221082 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.221046    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" path="/var/lib/kubelet/pods/1ffd9bf2-560d-4c42-81e2-45f0185e3283/volumes"
May 25 12:33:39.244765 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.244739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/prom-label-proxy/0.log"
May 25 12:33:39.282219 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.282181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f47be61-6c55-42b4-8d10-22554d789a81/init-config-reloader/0.log"
May 25 12:33:39.521008 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.520928    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fd48fc8df-xhghg_f44afac3-4402-4e75-8c96-d73d71d81a4c/metrics-server/0.log"
May 25 12:33:39.664763 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.664734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grxph_25796a72-fbc3-494d-9c68-cde37c09ff0e/node-exporter/0.log"
May 25 12:33:39.694913 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.694878    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grxph_25796a72-fbc3-494d-9c68-cde37c09ff0e/kube-rbac-proxy/0.log"
May 25 12:33:39.722867 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.722839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grxph_25796a72-fbc3-494d-9c68-cde37c09ff0e/init-textfile/0.log"
May 25 12:33:39.846643 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.846616    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vblcl_335d68e6-2b7e-4057-9d85-c249f17251f1/kube-rbac-proxy-main/0.log"
May 25 12:33:39.873612 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.873583    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vblcl_335d68e6-2b7e-4057-9d85-c249f17251f1/kube-rbac-proxy-self/0.log"
May 25 12:33:39.902051 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:39.902016    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vblcl_335d68e6-2b7e-4057-9d85-c249f17251f1/openshift-state-metrics/0.log"
May 25 12:33:40.151119 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.151035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-twrgp_3de2af86-03e9-463a-8f93-dc5221ddeed6/prometheus-operator/0.log"
May 25 12:33:40.176698 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.176668    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-twrgp_3de2af86-03e9-463a-8f93-dc5221ddeed6/kube-rbac-proxy/0.log"
May 25 12:33:40.210667 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.210639    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-2kgvl_d8b43d69-6965-4377-93d4-a19b977ea53f/prometheus-operator-admission-webhook/0.log"
May 25 12:33:40.247409 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.247380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9dc7fc59-nx64x_5c3b408b-e527-41dd-a3ac-aeb1be90ada1/telemeter-client/0.log"
May 25 12:33:40.276319 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.276288    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9dc7fc59-nx64x_5c3b408b-e527-41dd-a3ac-aeb1be90ada1/reload/0.log"
May 25 12:33:40.312960 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.312929    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9dc7fc59-nx64x_5c3b408b-e527-41dd-a3ac-aeb1be90ada1/kube-rbac-proxy/0.log"
May 25 12:33:40.349755 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.349728    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/thanos-query/0.log"
May 25 12:33:40.376564 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.376531    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/kube-rbac-proxy-web/0.log"
May 25 12:33:40.401685 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.401615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/kube-rbac-proxy/0.log"
May 25 12:33:40.428337 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.428309    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/prom-label-proxy/0.log"
May 25 12:33:40.452827 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.452803    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/kube-rbac-proxy-rules/0.log"
May 25 12:33:40.479718 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:40.479693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5695b7996-2ng9b_251a8dd7-24b2-40e8-b548-ca01759eae03/kube-rbac-proxy-metrics/0.log"
May 25 12:33:42.596474 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:42.596445    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6748bccc5c-4khsg_d0f38253-3a7c-4ba3-891b-a6a66c3b5f54/console/0.log"
May 25 12:33:42.629489 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:42.629455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-lbffj_c415d868-f9de-4ea2-b7a9-b0c4850a6a3c/download-server/0.log"
May 25 12:33:43.254963 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.254927    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"]
May 25 12:33:43.255324 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255310    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="copy"
May 25 12:33:43.255324 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255325    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="copy"
May 25 12:33:43.255432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255345    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="gather"
May 25 12:33:43.255432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255350    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="gather"
May 25 12:33:43.255432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255413    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="gather"
May 25 12:33:43.255432 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.255422    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ffd9bf2-560d-4c42-81e2-45f0185e3283" containerName="copy"
May 25 12:33:43.260541 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.260521    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.262571 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.262550    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhhvd\"/\"openshift-service-ca.crt\""
May 25 12:33:43.262795 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.262778    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhhvd\"/\"kube-root-ca.crt\""
May 25 12:33:43.262989 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.262975    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zhhvd\"/\"default-dockercfg-dzb8w\""
May 25 12:33:43.267015 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.266988    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"]
May 25 12:33:43.370918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.370873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-sys\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.370918 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.370924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-lib-modules\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.371161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.371014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqp2b\" (UniqueName: \"kubernetes.io/projected/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-kube-api-access-rqp2b\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.371161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.371060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-proc\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.371161 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.371079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-podres\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471744 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471709    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-sys\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471744 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-lib-modules\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471814    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqp2b\" (UniqueName: \"kubernetes.io/projected/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-kube-api-access-rqp2b\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471851    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-proc\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471871    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-podres\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471890    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-lib-modules\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.471942 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471917    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-proc\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.472104 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471950    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-sys\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.472104 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.471988    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-podres\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.481357 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.481326    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqp2b\" (UniqueName: \"kubernetes.io/projected/b0f0b5a0-bda9-46b2-a035-e3fa2777e551-kube-api-access-rqp2b\") pod \"perf-node-gather-daemonset-2svvs\" (UID: \"b0f0b5a0-bda9-46b2-a035-e3fa2777e551\") " pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.571010 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.570968    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.703684 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.703638    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"]
May 25 12:33:43.706470 ip-10-0-130-54 kubenswrapper[2575]: W0525 12:33:43.706441    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0f0b5a0_bda9_46b2_a035_e3fa2777e551.slice/crio-f60e1503f9d4c8977e2611e2afe0a35e8508c3330febcbee124b5e49d054ba03 WatchSource:0}: Error finding container f60e1503f9d4c8977e2611e2afe0a35e8508c3330febcbee124b5e49d054ba03: Status 404 returned error can't find the container with id f60e1503f9d4c8977e2611e2afe0a35e8508c3330febcbee124b5e49d054ba03
May 25 12:33:43.764555 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.764511    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-562sm_3f2fedc5-5e43-4030-9941-fee44a3fff85/dns/0.log"
May 25 12:33:43.791468 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.791436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-562sm_3f2fedc5-5e43-4030-9941-fee44a3fff85/kube-rbac-proxy/0.log"
May 25 12:33:43.885487 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.885450    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs" event={"ID":"b0f0b5a0-bda9-46b2-a035-e3fa2777e551","Type":"ContainerStarted","Data":"b304887540dec680a27644272609c9b87ecfe0ad17e83de114b4c10b45075f97"}
May 25 12:33:43.885487 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.885488    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs" event={"ID":"b0f0b5a0-bda9-46b2-a035-e3fa2777e551","Type":"ContainerStarted","Data":"f60e1503f9d4c8977e2611e2afe0a35e8508c3330febcbee124b5e49d054ba03"}
May 25 12:33:43.885712 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.885597    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:43.899563 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.899512    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs" podStartSLOduration=0.899496016 podStartE2EDuration="899.496016ms" podCreationTimestamp="2026-05-25 12:33:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:33:43.898327098 +0000 UTC m=+1293.243587951" watchObservedRunningTime="2026-05-25 12:33:43.899496016 +0000 UTC m=+1293.244756920"
May 25 12:33:43.983065 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:43.983027    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9ftx_ec72fddb-42e6-4e20-a256-ec9698f33035/dns-node-resolver/0.log"
May 25 12:33:44.446022 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:44.445992    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbkkn_b4077fd2-1ca5-4df0-8bec-ea87fd64832d/node-ca/0.log"
May 25 12:33:45.621181 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:45.621149    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l2qct_7547ff6a-aba2-47cf-a758-9c2acfe542c7/serve-healthcheck-canary/0.log"
May 25 12:33:46.104731 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:46.104704    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxkv5_beb76b6b-d6bb-45fe-ad40-a35edfc5697d/kube-rbac-proxy/0.log"
May 25 12:33:46.128725 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:46.128698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxkv5_beb76b6b-d6bb-45fe-ad40-a35edfc5697d/exporter/0.log"
May 25 12:33:46.155025 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:46.154991    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxkv5_beb76b6b-d6bb-45fe-ad40-a35edfc5697d/extractor/0.log"
May 25 12:33:48.176636 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:48.176606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-6b94ff949c-g2ss7_06699cb6-41a3-4b18-8525-6ea93ef1d6c9/manager/0.log"
May 25 12:33:48.202936 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:48.202909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-mjdzz_38366549-388f-48ce-9841-96e90748813b/server/0.log"
May 25 12:33:48.296002 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:48.295970    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-696fc77849-bmj7w_f71d71f2-9198-421e-ab40-89015ec835a2/manager/0.log"
May 25 12:33:48.347445 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:48.347418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-47t5x_082adc48-7102-4f6f-b0e5-36bf33bcd8fe/seaweedfs/0.log"
May 25 12:33:49.898406 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:49.898369    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zhhvd/perf-node-gather-daemonset-2svvs"
May 25 12:33:53.915216 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:53.915178    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/kube-multus-additional-cni-plugins/0.log"
May 25 12:33:53.940136 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:53.940107    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/egress-router-binary-copy/0.log"
May 25 12:33:53.965288 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:53.965263    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/cni-plugins/0.log"
May 25 12:33:53.991096 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:53.991067    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/bond-cni-plugin/0.log"
May 25 12:33:54.017130 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.017099    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/routeoverride-cni/0.log"
May 25 12:33:54.042708 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.042681    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/whereabouts-cni-bincopy/0.log"
May 25 12:33:54.070448 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.070416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nngk4_a63dfa7d-c9e5-4a6a-9d5e-9193b276f2b9/whereabouts-cni/0.log"
May 25 12:33:54.340590 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.340564    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tvl7s_4b9a351f-dbad-450b-af37-58ec64475ee2/kube-multus/0.log"
May 25 12:33:54.421746 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.421712    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rl5f_d5494f26-2f09-4c5d-b8f1-d3c5779af603/network-metrics-daemon/0.log"
May 25 12:33:54.453312 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:54.453276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rl5f_d5494f26-2f09-4c5d-b8f1-d3c5779af603/kube-rbac-proxy/0.log"
May 25 12:33:56.032488 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.032444    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-controller/0.log"
May 25 12:33:56.055815 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.055782    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/0.log"
May 25 12:33:56.062816 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.062757    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovn-acl-logging/1.log"
May 25 12:33:56.083580 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.083538    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/kube-rbac-proxy-node/0.log"
May 25 12:33:56.108297 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.108270    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/kube-rbac-proxy-ovn-metrics/0.log"
May 25 12:33:56.131881 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.131847    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/northd/0.log"
May 25 12:33:56.155494 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.155460    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/nbdb/0.log"
May 25 12:33:56.179458 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.179428    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/sbdb/0.log"
May 25 12:33:56.302106 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:56.302074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztrgm_5727767b-83e6-4d1d-86eb-9eaa30653a27/ovnkube-controller/0.log"
May 25 12:33:57.394715 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:57.394689    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8pjfw_f85781fe-8eab-4a4f-b572-4d73e4ce4d58/network-check-target-container/0.log"
May 25 12:33:58.360833 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:58.360806    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-j5vc2_bffdccb1-6aa4-4e70-b962-7da8fe2da1b9/iptables-alerter/0.log"
May 25 12:33:59.124865 ip-10-0-130-54 kubenswrapper[2575]: I0525 12:33:59.124832    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hs4bg_e38f73cd-5ca6-44ce-bbe2-2a7cd39549e6/tuned/0.log"