Apr 24 21:26:56.031885 ip-10-0-129-204 systemd[1]: Starting Kubernetes Kubelet... Apr 24 21:26:56.442685 ip-10-0-129-204 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:26:56.442685 ip-10-0-129-204 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 24 21:26:56.442685 ip-10-0-129-204 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:26:56.442685 ip-10-0-129-204 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 24 21:26:56.442685 ip-10-0-129-204 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:26:56.443317 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.442761 2571 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 24 21:26:56.447339 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447322 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:26:56.447339 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447339 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447343 2571 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447346 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447348 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447351 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447353 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447356 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447359 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447362 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447365 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447367 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447370 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447373 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447375 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447378 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447380 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447390 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447393 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447395 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447398 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:26:56.447409 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447400 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447403 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447405 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447408 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447410 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447413 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447416 2571 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447418 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447421 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447424 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447426 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447429 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447431 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447434 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447436 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447440 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447444 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447446 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447449 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:26:56.447910 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447451 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447455 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447457 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447460 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447462 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447464 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447467 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447469 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447472 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447474 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447477 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447481 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447485 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447488 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447491 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447494 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447497 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447500 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447502 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447505 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:26:56.448456 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447507 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447510 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447512 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447515 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447517 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447520 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447522 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447531 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447534 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447537 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447539 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447542 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447545 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447548 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447551 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447554 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447557 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447559 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447561 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447564 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:26:56.448953 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447566 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447569 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447571 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447575 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447578 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447580 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447971 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447978 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447982 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447984 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447987 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447989 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447992 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447994 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.447997 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448000 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448002 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448005 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448008 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:26:56.449464 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448012 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448015 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448017 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448020 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448022 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448025 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448027 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448030 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448032 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448035 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448037 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448040 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448042 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448044 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448047 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448049 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448053 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448056 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448058 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448060 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:26:56.449967 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448064 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448067 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448069 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448071 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448074 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448076 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448079 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448081 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448083 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448086 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448088 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448090 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448093 2571 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448095 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448097 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448100 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448103 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448105 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448107 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448110 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:26:56.450479 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448112 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448114 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448117 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448119 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448122 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448124 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448126 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448129 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448131 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448135 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448138 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448140 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448144 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448147 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448149 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448151 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448154 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448156 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448158 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448161 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:26:56.450972 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448163 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448166 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448168 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448170 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448173 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448175 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448178 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448180 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448182 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448185 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448187 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448189 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448192 2571 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448262 2571 flags.go:64] FLAG: --address="0.0.0.0" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448269 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448275 2571 flags.go:64] FLAG: --anonymous-auth="true" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448279 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448284 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448288 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448292 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448297 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 24 21:26:56.451450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448300 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448303 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448307 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448310 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448313 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448316 2571 flags.go:64] FLAG: --cgroup-root="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448319 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448322 2571 flags.go:64] FLAG: --client-ca-file="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448324 2571 flags.go:64] FLAG: --cloud-config="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448327 2571 flags.go:64] FLAG: --cloud-provider="external" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448330 2571 flags.go:64] FLAG: --cluster-dns="[]" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448334 2571 flags.go:64] FLAG: --cluster-domain="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448337 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448339 2571 flags.go:64] FLAG: --config-dir="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448342 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448345 2571 flags.go:64] FLAG: --container-log-max-files="5" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448349 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448352 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448355 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448358 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448361 2571 flags.go:64] FLAG: --contention-profiling="false" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448365 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448367 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448370 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448373 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 24 21:26:56.451969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448382 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448385 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448388 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448391 2571 flags.go:64] FLAG: --enable-load-reader="false" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448394 2571 flags.go:64] FLAG: --enable-server="true" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448397 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448400 2571 flags.go:64] FLAG: --event-burst="100" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448403 2571 flags.go:64] FLAG: --event-qps="50" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448406 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448409 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448415 2571 flags.go:64] FLAG: --eviction-hard="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448419 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448422 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448424 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448427 2571 flags.go:64] FLAG: --eviction-soft="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448430 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448433 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448436 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448439 2571 flags.go:64] FLAG: --experimental-mounter-path="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448442 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448445 2571 flags.go:64] FLAG: --fail-swap-on="true" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448447 2571 flags.go:64] FLAG: --feature-gates="" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448451 2571 flags.go:64] FLAG: --file-check-frequency="20s" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448454 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448457 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 24 21:26:56.452569 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448460 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448464 2571 flags.go:64] FLAG: --healthz-port="10248" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448467 2571 flags.go:64] FLAG: --help="false" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448470 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448473 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448476 2571 flags.go:64] FLAG: --http-check-frequency="20s" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448479 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448482 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448486 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448488 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448491 2571 flags.go:64] FLAG: --image-service-endpoint="" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448494 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448496 2571 flags.go:64] FLAG: --kube-api-burst="100" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448499 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448502 2571 flags.go:64] FLAG: --kube-api-qps="50" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448505 2571 flags.go:64] FLAG: --kube-reserved="" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448508 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448512 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448515 2571 flags.go:64] FLAG: --kubelet-cgroups="" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448518 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448521 2571 flags.go:64] FLAG: --lock-file="" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448524 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448526 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448529 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 24 21:26:56.453183 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448534 2571 flags.go:64] FLAG: --log-json-split-stream="false" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448537 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448539 2571 flags.go:64] FLAG: --log-text-split-stream="false" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448542 2571 flags.go:64] FLAG: --logging-format="text" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448545 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448548 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448551 2571 flags.go:64] FLAG: --manifest-url="" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448553 2571 flags.go:64] FLAG: --manifest-url-header="" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448558 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448561 2571 flags.go:64] FLAG: --max-open-files="1000000" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448565 2571 flags.go:64] FLAG: --max-pods="110" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448568 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448571 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448574 2571 flags.go:64] FLAG: --memory-manager-policy="None" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448577 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448580 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448601 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448606 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448627 2571 flags.go:64] FLAG: --node-status-max-images="50" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448631 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448634 2571 flags.go:64] FLAG: --oom-score-adj="-999" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448637 2571 flags.go:64] FLAG: --pod-cidr="" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448639 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 24 21:26:56.453779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448645 2571 flags.go:64] FLAG: --pod-manifest-path="" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448647 2571 flags.go:64] FLAG: --pod-max-pids="-1" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448650 2571 flags.go:64] FLAG: --pods-per-core="0" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448659 2571 flags.go:64] FLAG: --port="10250" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448662 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448665 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e4768549dfd2be65" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448668 2571 flags.go:64] FLAG: --qos-reserved="" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448671 2571 flags.go:64] FLAG: --read-only-port="10255" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448674 2571 flags.go:64] FLAG: --register-node="true" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448677 2571 flags.go:64] FLAG: --register-schedulable="true" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448679 2571 flags.go:64] FLAG: --register-with-taints="" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448683 2571 flags.go:64] FLAG: --registry-burst="10" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448686 2571 flags.go:64] FLAG: --registry-qps="5" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448688 2571 flags.go:64] FLAG: --reserved-cpus="" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448691 2571 flags.go:64] FLAG: --reserved-memory="" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448695 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448698 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448700 2571 flags.go:64] FLAG: --rotate-certificates="false" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448703 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448706 2571 flags.go:64] FLAG: --runonce="false" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448709 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448712 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448715 2571 flags.go:64] FLAG: --seccomp-default="false" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448718 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448721 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448724 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 24 21:26:56.454336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448727 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448730 2571 flags.go:64] FLAG: --storage-driver-password="root" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448733 2571 flags.go:64] FLAG: --storage-driver-secure="false" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448736 2571 flags.go:64] FLAG: --storage-driver-table="stats" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448738 2571 flags.go:64] FLAG: --storage-driver-user="root" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448741 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448744 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448747 2571 flags.go:64] FLAG: --system-cgroups="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448750 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448757 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448760 2571 flags.go:64] FLAG: --tls-cert-file="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448763 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448767 2571 flags.go:64] FLAG: --tls-min-version="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448770 2571 flags.go:64] FLAG: --tls-private-key-file="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448773 2571 flags.go:64] FLAG: --topology-manager-policy="none" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448775 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448779 2571 flags.go:64] FLAG: --topology-manager-scope="container" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448781 2571 flags.go:64] FLAG: --v="2" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448786 2571 flags.go:64] FLAG: --version="false" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448790 2571 flags.go:64] FLAG: --vmodule="" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448794 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.448797 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448886 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448889 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448892 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:26:56.454954 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448895 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448898 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448901 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448903 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448906 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448908 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448911 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448913 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448916 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448918 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448920 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448923 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448925 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448927 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448930 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448932 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448936 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448938 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448941 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448944 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:26:56.455742 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448946 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448948 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448951 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448953 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448956 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448958 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448961 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448963 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448966 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448968 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448970 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448973 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448975 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448980 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448983 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448985 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448987 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448990 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448993 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:26:56.456645 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448995 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.448999 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449003 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449006 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449009 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449012 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449014 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449017 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449019 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449023 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449026 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449029 2571 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449032 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449035 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449037 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449040 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449044 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449047 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449050 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:26:56.457376 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449053 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449056 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449058 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449060 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449063 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449066 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449068 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449072 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449074 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449076 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449079 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449081 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449084 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449086 2571 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449089 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449091 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449093 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449096 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449098 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449100 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:26:56.457886 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449103 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:26:56.458359 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449105 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:26:56.458359 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449109 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:26:56.458359 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449111 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:26:56.458359 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.449114 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:26:56.458359 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.450079 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:26:56.459266 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.459247 2571 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 24 21:26:56.459302 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.459267 2571 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 24 21:26:56.459330 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459319 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:26:56.459330 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459324 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:26:56.459330 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459328 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:26:56.459330 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459331 2571 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459336 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459341 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459345 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459348 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459351 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459353 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459356 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459359 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459361 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459364 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459371 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459374 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459376 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459379 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459382 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459385 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459387 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459390 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:26:56.459428 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459392 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459395 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459397 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459400 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459402 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459405 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459407 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459410 2571 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459413 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459415 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459417 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459420 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459422 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459425 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459427 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459447 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459451 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459453 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459456 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459459 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:26:56.459911 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459462 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459465 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459467 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459470 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459473 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459475 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459478 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459480 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459483 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459485 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459488 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459490 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459492 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459495 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459497 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459500 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459503 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459505 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459508 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459511 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:26:56.460387 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459513 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459516 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459518 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459521 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459523 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459526 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459529 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459532 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459534 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459538 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459542 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459545 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459547 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459550 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459553 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459556 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459558 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459561 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459563 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:26:56.460881 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459565 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459568 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459570 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459572 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459575 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.459579 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459697 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459703 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459706 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459708 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459711 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459713 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459716 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459718 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459721 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:26:56.461378 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459723 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459726 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459729 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459731 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459734 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459736 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459739 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459741 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459744 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459747 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459749 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459751 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459754 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459758 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459760 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459764 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459768 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459770 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459773 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:26:56.461766 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459775 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459778 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459781 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459783 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459785 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459788 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459790 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459793 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459795 2571 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459797 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459800 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459802 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459804 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459807 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459809 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459812 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459814 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459816 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459819 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459822 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:26:56.462225 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459824 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459826 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459829 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459831 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459834 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459836 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459839 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459842 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459844 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459847 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459849 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459852 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459854 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459856 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459859 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459861 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459864 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459866 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459868 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459871 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:26:56.462713 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459873 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459875 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459878 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459881 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459884 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459886 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459889 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459891 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459893 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459896 2571 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459899 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459901 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459904 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459906 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459909 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459911 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459913 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:26:56.463191 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:56.459916 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.459921 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.460029 2571 server.go:962] "Client rotation is on, will bootstrap in background" Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.462540 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.463452 2571 server.go:1019] "Starting client certificate rotation" Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.463544 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 21:26:56.463611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.463574 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 21:26:56.487199 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.487180 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 21:26:56.488952 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.488932 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 21:26:56.505178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.505157 2571 log.go:25] "Validated CRI v1 runtime API" Apr 24 21:26:56.510657 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.510641 2571 log.go:25] "Validated CRI v1 image API" Apr 24 21:26:56.511971 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.511955 2571 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 24 21:26:56.517065 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.517047 2571 fs.go:135] Filesystem UUIDs: map[180db548-bb4f-40e9-b971-6a85528e7edf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 df62d24f-ed33-45cc-aea1-18c396cc241d:/dev/nvme0n1p3] Apr 24 21:26:56.517126 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.517065 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 24 21:26:56.519835 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.519808 2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 21:26:56.524745 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.524627 2571 manager.go:217] Machine: {Timestamp:2026-04-24 21:26:56.522437097 +0000 UTC m=+0.377196780 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087825 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec286d7d95a399a687b7a5435f82a648 SystemUUID:ec286d7d-95a3-99a6-87b7-a5435f82a648 BootID:7628f0ee-7e2a-494e-8a27-c17047257160 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7b:21:ae:7a:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7b:21:ae:7a:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:37:fa:35:1d:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 24 21:26:56.525328 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.525317 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 24 21:26:56.525438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.525427 2571 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 24 21:26:56.526233 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.526212 2571 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 24 21:26:56.526370 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.526236 2571 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 24 21:26:56.526412 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.526379 2571 topology_manager.go:138] "Creating topology manager with none policy" Apr 24 21:26:56.526412 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.526389 2571 container_manager_linux.go:306] "Creating device plugin manager" Apr 24 21:26:56.526412 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.526402 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 21:26:56.527174 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.527164 2571 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 21:26:56.527898 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.527889 2571 state_mem.go:36] "Initialized new in-memory state store" Apr 24 21:26:56.528155 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.528146 2571 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 24 21:26:56.530682 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.530671 2571 kubelet.go:491] "Attempting to sync node with API server" Apr 24 21:26:56.530732 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.530690 2571 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 24 21:26:56.530732 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.530707 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 24 21:26:56.530732 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.530717 2571 kubelet.go:397] "Adding apiserver pod source" Apr 24 21:26:56.530732 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.530728 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 24 21:26:56.532190 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.532178 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 21:26:56.532225 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.532198 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 21:26:56.535467 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.535452 2571 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 24 21:26:56.536864 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.536848 2571 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 24 21:26:56.538572 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538560 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538576 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538600 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538609 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538615 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538621 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 24 21:26:56.538626 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538626 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 24 21:26:56.538786 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538631 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 24 21:26:56.538786 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538637 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 24 21:26:56.538786 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538643 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 24 21:26:56.538786 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538652 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 24 21:26:56.538786 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.538662 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 24 21:26:56.539408 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.539398 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 24 21:26:56.539443 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.539410 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 24 21:26:56.541072 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.541050 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 24 21:26:56.541072 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.541052 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 24 21:26:56.543642 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543628 2571 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 24 21:26:56.543711 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543665 2571 server.go:1295] "Started kubelet" Apr 24 21:26:56.543813 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543772 2571 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 24 21:26:56.543865 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543807 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 24 21:26:56.543865 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543839 2571 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 24 21:26:56.543966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.543919 2571 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Apr 24 21:26:56.544334 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.544316 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph7hw" Apr 24 21:26:56.544523 ip-10-0-129-204 systemd[1]: Started Kubernetes Kubelet. Apr 24 21:26:56.545229 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.545210 2571 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 24 21:26:56.546169 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.546151 2571 server.go:317] "Adding debug handlers to kubelet server" Apr 24 21:26:56.551368 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.551347 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 24 21:26:56.551368 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.551364 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 24 21:26:56.552381 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.552331 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:56.553666 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.553641 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph7hw" Apr 24 21:26:56.554158 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.554142 2571 factory.go:55] Registering systemd factory Apr 24 21:26:56.554241 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.554205 2571 factory.go:223] Registration of the systemd container factory successfully Apr 24 21:26:56.554699 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.554666 2571 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 24 21:26:56.554976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.554959 2571 factory.go:153] Registering CRI-O factory Apr 24 21:26:56.554976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.554978 2571 factory.go:223] Registration of the crio container factory successfully Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555063 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555086 2571 factory.go:103] Registering Raw factory Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555099 2571 manager.go:1196] Started watching for new ooms in manager Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.555332 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.555353 2571 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555576 2571 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 24 21:26:56.555611 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555612 2571 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 24 21:26:56.555943 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555695 2571 manager.go:319] Starting recovery of all containers Apr 24 21:26:56.555943 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555737 2571 reconstruct.go:97] "Volume reconstruction finished" Apr 24 21:26:56.555943 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.555744 2571 reconciler.go:26] "Reconciler: start to sync state" Apr 24 21:26:56.555943 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.555848 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Apr 24 21:26:56.556651 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.555518 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-204.ec2.internal.18a9682072808ccf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-204.ec2.internal,UID:ip-10-0-129-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-204.ec2.internal,},FirstTimestamp:2026-04-24 21:26:56.543640783 +0000 UTC m=+0.398400464,LastTimestamp:2026-04-24 21:26:56.543640783 +0000 UTC m=+0.398400464,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-204.ec2.internal,}" Apr 24 21:26:56.567785 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.567577 2571 manager.go:324] Recovery completed Apr 24 21:26:56.571568 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.571555 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.574136 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574120 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.574136 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574148 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.574264 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574159 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.574653 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574637 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 24 21:26:56.574653 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574654 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 24 21:26:56.574756 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.574671 2571 state_mem.go:36] "Initialized new in-memory state store" Apr 24 21:26:56.576702 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.576640 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-204.ec2.internal.18a968207451deea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-204.ec2.internal,UID:ip-10-0-129-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-204.ec2.internal,},FirstTimestamp:2026-04-24 21:26:56.574136042 +0000 UTC m=+0.428895721,LastTimestamp:2026-04-24 21:26:56.574136042 +0000 UTC m=+0.428895721,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-204.ec2.internal,}" Apr 24 21:26:56.577114 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.577101 2571 policy_none.go:49] "None policy: Start" Apr 24 21:26:56.577168 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.577118 2571 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 24 21:26:56.577168 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.577130 2571 state_mem.go:35] "Initializing new in-memory state store" Apr 24 21:26:56.626209 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626190 2571 manager.go:341] "Starting Device Plugin manager" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.626235 2571 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626249 2571 server.go:85] "Starting device plugin registration server" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626453 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626464 2571 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626570 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626673 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.626680 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 24 21:26:56.627210 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.627188 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 24 21:26:56.627636 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.627224 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:56.685051 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.685025 2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 24 21:26:56.686386 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.686359 2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 24 21:26:56.686386 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.686387 2571 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 24 21:26:56.686529 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.686403 2571 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 24 21:26:56.686529 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.686410 2571 kubelet.go:2451] "Starting kubelet main sync loop" Apr 24 21:26:56.686529 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.686439 2571 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 24 21:26:56.689048 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.689031 2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:26:56.726982 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.726940 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.727877 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.727861 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.727954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.727894 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.727954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.727910 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.727954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.727940 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.736010 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.735996 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.736081 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.736015 2571 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-204.ec2.internal\": node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:56.758066 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.758045 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:56.787022 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.786999 2571 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal"] Apr 24 21:26:56.787109 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.787081 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.787907 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.787891 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.787967 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.787921 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.787967 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.787936 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.790215 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.790200 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.790399 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.790385 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.790442 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.790412 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.791004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.790989 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.791072 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.791014 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.791072 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.791037 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.791072 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.791051 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.791188 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.791075 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.791188 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.791112 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.793256 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.793243 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.793324 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.793280 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:26:56.794437 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.794419 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:26:56.794512 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.794448 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:26:56.794512 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.794462 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:26:56.825189 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.825165 2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-204.ec2.internal\" not found" node="ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.829489 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.829474 2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-204.ec2.internal\" not found" node="ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.857071 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.857044 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.857161 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.857075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.857161 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.857093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd54af8f80e3b05db4203800e6cae347-config\") pod \"kube-apiserver-proxy-ip-10-0-129-204.ec2.internal\" (UID: \"dd54af8f80e3b05db4203800e6cae347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.858506 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.858490 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:56.957641 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957609 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.957805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957647 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.957805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957667 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd54af8f80e3b05db4203800e6cae347-config\") pod \"kube-apiserver-proxy-ip-10-0-129-204.ec2.internal\" (UID: \"dd54af8f80e3b05db4203800e6cae347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.957805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957705 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.957805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957724 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/684f5b9427f067db6bbddee483185b81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal\" (UID: \"684f5b9427f067db6bbddee483185b81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.957805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:56.957711 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd54af8f80e3b05db4203800e6cae347-config\") pod \"kube-apiserver-proxy-ip-10-0-129-204.ec2.internal\" (UID: \"dd54af8f80e3b05db4203800e6cae347\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:56.958633 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:56.958617 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.058987 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.058916 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.127141 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.127108 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:57.131625 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.131608 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:57.159381 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.159349 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.259960 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.259930 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.360544 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.360488 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.461097 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.461068 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.463233 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.463216 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 24 21:26:57.463352 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.463337 2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 21:26:57.552456 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.552432 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 24 21:26:57.556737 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.556696 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-23 21:21:56 +0000 UTC" deadline="2027-09-21 07:44:43.083056135 +0000 UTC" Apr 24 21:26:57.556737 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.556730 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12346h17m45.526328905s" Apr 24 21:26:57.561138 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.561119 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.563408 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.563382 2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 21:26:57.584438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.584414 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ltr8" Apr 24 21:26:57.590614 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.590598 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ltr8" Apr 24 21:26:57.652273 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:57.652246 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684f5b9427f067db6bbddee483185b81.slice/crio-97566ff7013e30691f22e44e9c11c1601e53f951cb0ebde76499161d6eba578e WatchSource:0}: Error finding container 97566ff7013e30691f22e44e9c11c1601e53f951cb0ebde76499161d6eba578e: Status 404 returned error can't find the container with id 97566ff7013e30691f22e44e9c11c1601e53f951cb0ebde76499161d6eba578e Apr 24 21:26:57.652497 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:57.652484 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd54af8f80e3b05db4203800e6cae347.slice/crio-88916a950f20dfc9f1e464c12226e5bc244032de6a003f946779cb9948206f26 WatchSource:0}: Error finding container 88916a950f20dfc9f1e464c12226e5bc244032de6a003f946779cb9948206f26: Status 404 returned error can't find the container with id 88916a950f20dfc9f1e464c12226e5bc244032de6a003f946779cb9948206f26 Apr 24 21:26:57.657097 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.657083 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 21:26:57.661723 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.661705 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.689712 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.689663 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" event={"ID":"dd54af8f80e3b05db4203800e6cae347","Type":"ContainerStarted","Data":"88916a950f20dfc9f1e464c12226e5bc244032de6a003f946779cb9948206f26"} Apr 24 21:26:57.690666 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.690640 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" event={"ID":"684f5b9427f067db6bbddee483185b81","Type":"ContainerStarted","Data":"97566ff7013e30691f22e44e9c11c1601e53f951cb0ebde76499161d6eba578e"} Apr 24 21:26:57.737993 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.737962 2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:26:57.761914 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:57.761890 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-204.ec2.internal\" not found" Apr 24 21:26:57.801482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.801459 2571 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:26:57.851614 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.851577 2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" Apr 24 21:26:57.866441 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.866423 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 21:26:57.867309 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.867295 2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" Apr 24 21:26:57.876298 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.876282 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 21:26:57.961274 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:57.961210 2571 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:26:58.443235 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.443163 2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:26:58.532057 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.532030 2571 apiserver.go:52] "Watching apiserver" Apr 24 21:26:58.538340 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.538321 2571 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 24 21:26:58.541282 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.541247 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr","openshift-cluster-node-tuning-operator/tuned-mt7m9","openshift-image-registry/node-ca-m7lqt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal","openshift-multus/multus-additional-cni-plugins-xglrz","openshift-multus/network-metrics-daemon-4h277","openshift-network-diagnostics/network-check-target-ztccj","kube-system/konnectivity-agent-cl2mg","openshift-dns/node-resolver-qbbz5","openshift-multus/multus-zhk5d","openshift-network-operator/iptables-alerter-ls8pz","openshift-ovn-kubernetes/ovnkube-node-kc9kf"] Apr 24 21:26:58.544206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.544182 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.544302 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.544276 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:26:58.546364 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.546344 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.548529 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.548509 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.551146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.550854 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.551718 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.551697 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 24 21:26:58.551795 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.551709 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.551846 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.551797 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.551909 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.551798 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tc6vd\"" Apr 24 21:26:58.553145 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.553125 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.554809 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.554790 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.555447 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.555429 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:26:58.555535 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.555516 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:26:58.556031 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556000 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kjl5r\"" Apr 24 21:26:58.556164 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556147 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.556280 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556264 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.556344 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556264 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 24 21:26:58.556451 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556344 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 24 21:26:58.556513 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.556463 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 24 21:26:58.557141 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.557114 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cklfj\"" Apr 24 21:26:58.557248 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.557230 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.557795 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.557781 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.558357 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.558337 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 24 21:26:58.558596 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.558564 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f6cv6\"" Apr 24 21:26:58.560025 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.560005 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m6fp9\"" Apr 24 21:26:58.564851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.562140 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 24 21:26:58.564851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.562647 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.564851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.562892 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.564851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.562929 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.566717 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566692 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-device-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.566800 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566730 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.566800 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566759 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysconfig\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.566882 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566809 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-tuned\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.566882 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566844 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88pb\" (UniqueName: \"kubernetes.io/projected/45e86ed3-921a-4890-a847-d104835d5b0a-kube-api-access-d88pb\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwwm\" (UniqueName: \"kubernetes.io/projected/7151d443-18e1-458e-a1d5-d2536594c786-kube-api-access-4fwwm\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.567004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566933 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566958 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.566981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-var-lib-kubelet\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-modprobe-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567072 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-systemd\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-system-cni-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567143 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567186 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.567236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567226 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-tmp\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567254 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567281 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567304 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-socket-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-lib-modules\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567349 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqtjc\" (UniqueName: \"kubernetes.io/projected/b385beab-9951-427c-a9de-0bc29fc3a8fe-kube-api-access-zqtjc\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567379 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqd8p\" (UniqueName: \"kubernetes.io/projected/2923cb02-1e0e-472a-860f-e4235540cee0-kube-api-access-mqd8p\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567402 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-run\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567445 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567423 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-sys\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567444 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-registration-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567466 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-os-release\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567503 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-host\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567524 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567545 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-conf\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567566 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-sys-fs\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567606 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-kubernetes\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567633 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-host\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567655 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-serviceca\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567678 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnh9t\" (UniqueName: \"kubernetes.io/projected/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-kube-api-access-xnh9t\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.567724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.567700 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-cnibin\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.568123 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568102 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.568270 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568250 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.568372 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568284 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 24 21:26:58.568372 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568254 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 24 21:26:58.568684 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568654 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4ldgr\"" Apr 24 21:26:58.568760 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568702 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.568821 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568767 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8bhxp\"" Apr 24 21:26:58.568821 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568670 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.568941 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.568928 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.577288 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.577270 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.577371 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.577326 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 24 21:26:58.578077 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.578059 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.578172 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.578076 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 24 21:26:58.578172 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.578082 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 24 21:26:58.578172 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.578098 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 24 21:26:58.579737 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.579713 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 24 21:26:58.579820 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.579734 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f45lh\"" Apr 24 21:26:58.580010 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.579991 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pdvjd\"" Apr 24 21:26:58.580093 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.580034 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 24 21:26:58.580187 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.580165 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 24 21:26:58.591871 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.591664 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:21:57 +0000 UTC" deadline="2027-11-21 09:14:08.61593887 +0000 UTC" Apr 24 21:26:58.591871 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.591691 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13811h47m10.024251823s" Apr 24 21:26:58.655424 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.655401 2571 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 24 21:26:58.668160 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668127 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-os-release\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.668267 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668169 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-host\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668267 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668192 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668263 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-os-release\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.668362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668318 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-conf\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668348 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-ovn\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668342 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668422 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-kubernetes\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668446 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-host\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668459 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysctl-conf\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668470 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnh9t\" (UniqueName: \"kubernetes.io/projected/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-kube-api-access-xnh9t\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668500 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-device-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668519 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-host\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668534 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-netns\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668552 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-host\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668560 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsgz4\" (UniqueName: \"kubernetes.io/projected/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-kube-api-access-rsgz4\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668595 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-kubernetes\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668609 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysconfig\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668625 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-device-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668636 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwwm\" (UniqueName: \"kubernetes.io/projected/7151d443-18e1-458e-a1d5-d2536594c786-kube-api-access-4fwwm\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668662 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-kubelet\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668690 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovn-node-metrics-cert\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cnibin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668773 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cni-binary-copy\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668813 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc270e88-39fa-4781-966a-36f26b64340e-agent-certs\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668839 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-socket-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668881 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-node-log\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668896 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-sysconfig\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668906 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-netd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668936 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.668998 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668960 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-var-lib-kubelet\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.668995 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-modprobe-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669020 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669045 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-netns\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-socket-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669106 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-bin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669138 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c69570d-a54a-4d3c-993e-262b21ce1b2a-iptables-alerter-script\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669156 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc270e88-39fa-4781-966a-36f26b64340e-konnectivity-ca\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669174 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqtjc\" (UniqueName: \"kubernetes.io/projected/b385beab-9951-427c-a9de-0bc29fc3a8fe-kube-api-access-zqtjc\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669190 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-config\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669217 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c69570d-a54a-4d3c-993e-262b21ce1b2a-host-slash\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669233 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-run\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669250 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-registration-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669273 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-var-lib-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669290 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-script-lib\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669304 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.669772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669318 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-multus\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669333 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8824dd66-c4e0-4bc5-86b8-8819373b88d8-hosts-file\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669349 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-sys-fs\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669365 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-etc-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-bin\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669395 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-k8s-cni-cncf-io\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669410 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-hostroot\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669424 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-multus-certs\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669438 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-serviceca\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669453 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-cnibin\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669468 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669485 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-socket-dir-parent\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669502 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-tuned\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669519 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669537 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d88pb\" (UniqueName: \"kubernetes.io/projected/45e86ed3-921a-4890-a847-d104835d5b0a-kube-api-access-d88pb\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669555 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-systemd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669722 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.670468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-log-socket\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669799 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-env-overrides\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669812 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z98j\" (UniqueName: \"kubernetes.io/projected/9c69570d-a54a-4d3c-993e-262b21ce1b2a-kube-api-access-6z98j\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669852 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669849 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669878 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-registration-dir\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669888 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669913 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-sys-fs\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669915 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-system-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669944 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-kubelet\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-daemon-config\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669993 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-etc-kubernetes\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670020 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-systemd-units\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670050 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-systemd\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670078 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-system-cni-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-os-release\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670131 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-conf-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.669854 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-run\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670214 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-serviceca\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670234 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-system-cni-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670244 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824dd66-c4e0-4bc5-86b8-8819373b88d8-tmp-dir\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670278 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-tmp\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670299 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670317 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2923cb02-1e0e-472a-860f-e4235540cee0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670306 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670327 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-modprobe-d\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670358 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-var-lib-kubelet\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670365 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670427 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-lib-modules\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670448 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqd8p\" (UniqueName: \"kubernetes.io/projected/2923cb02-1e0e-472a-860f-e4235540cee0-kube-api-access-mqd8p\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670489 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45e86ed3-921a-4890-a847-d104835d5b0a-cnibin\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-slash\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.670533 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670555 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfv6d\" (UniqueName: \"kubernetes.io/projected/1f753fd6-6a03-4817-9e99-29a3525dbf1e-kube-api-access-jfv6d\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.671966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670630 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-sys\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670657 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-systemd\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670664 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pdz\" (UniqueName: \"kubernetes.io/projected/8824dd66-c4e0-4bc5-86b8-8819373b88d8-kube-api-access-56pdz\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.670699 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:26:59.170679244 +0000 UTC m=+3.025438935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670743 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-sys\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.670823 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b385beab-9951-427c-a9de-0bc29fc3a8fe-lib-modules\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.672567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.671073 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45e86ed3-921a-4890-a847-d104835d5b0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.673734 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.673712 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-etc-tuned\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.673815 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.673756 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b385beab-9951-427c-a9de-0bc29fc3a8fe-tmp\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.697321 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.697252 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnh9t\" (UniqueName: \"kubernetes.io/projected/d3cfa15a-8e10-489d-94cd-7b8da6f3b83b-kube-api-access-xnh9t\") pod \"node-ca-m7lqt\" (UID: \"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b\") " pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.702392 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.702373 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:26:58.702392 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.702392 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:26:58.702742 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.702401 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:26:58.702742 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:58.702456 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:26:59.202444012 +0000 UTC m=+3.057203679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:26:58.703654 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.703631 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqtjc\" (UniqueName: \"kubernetes.io/projected/b385beab-9951-427c-a9de-0bc29fc3a8fe-kube-api-access-zqtjc\") pod \"tuned-mt7m9\" (UID: \"b385beab-9951-427c-a9de-0bc29fc3a8fe\") " pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.704564 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.704525 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88pb\" (UniqueName: \"kubernetes.io/projected/45e86ed3-921a-4890-a847-d104835d5b0a-kube-api-access-d88pb\") pod \"multus-additional-cni-plugins-xglrz\" (UID: \"45e86ed3-921a-4890-a847-d104835d5b0a\") " pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.705356 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.705333 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwwm\" (UniqueName: \"kubernetes.io/projected/7151d443-18e1-458e-a1d5-d2536594c786-kube-api-access-4fwwm\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:58.709110 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.708749 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqd8p\" (UniqueName: \"kubernetes.io/projected/2923cb02-1e0e-472a-860f-e4235540cee0-kube-api-access-mqd8p\") pod \"aws-ebs-csi-driver-node-cwgzr\" (UID: \"2923cb02-1e0e-472a-860f-e4235540cee0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.771776 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771732 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-socket-dir-parent\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.771776 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771777 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-systemd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771794 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-log-socket\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771816 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-env-overrides\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771840 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z98j\" (UniqueName: \"kubernetes.io/projected/9c69570d-a54a-4d3c-993e-262b21ce1b2a-kube-api-access-6z98j\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771865 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771872 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-systemd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771881 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-log-socket\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771890 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-socket-dir-parent\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771909 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-system-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771935 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-kubelet\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771948 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.771960 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-daemon-config\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772004 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-system-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772030 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-etc-kubernetes\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772049 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-systemd-units\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772065 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-os-release\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772086 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-conf-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772105 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824dd66-c4e0-4bc5-86b8-8819373b88d8-tmp-dir\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772141 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-slash\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772161 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfv6d\" (UniqueName: \"kubernetes.io/projected/1f753fd6-6a03-4817-9e99-29a3525dbf1e-kube-api-access-jfv6d\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-systemd-units\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772186 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56pdz\" (UniqueName: \"kubernetes.io/projected/8824dd66-c4e0-4bc5-86b8-8819373b88d8-kube-api-access-56pdz\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772204 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-ovn\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772216 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-etc-kubernetes\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772219 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772245 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772262 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-netns\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772287 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-os-release\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772289 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgz4\" (UniqueName: \"kubernetes.io/projected/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-kube-api-access-rsgz4\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772310 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-conf-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.772623 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772317 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-kubelet\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772344 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772351 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-env-overrides\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772372 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovn-node-metrics-cert\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772397 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cnibin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772412 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-kubelet\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772419 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cni-binary-copy\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772446 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc270e88-39fa-4781-966a-36f26b64340e-agent-certs\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772455 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-daemon-config\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772470 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-node-log\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772494 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-netd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772556 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-netns\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772577 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824dd66-c4e0-4bc5-86b8-8819373b88d8-tmp-dir\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772604 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-bin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-slash\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772656 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-run-netns\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772705 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-run-ovn\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772745 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-kubelet\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.773438 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772745 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c69570d-a54a-4d3c-993e-262b21ce1b2a-iptables-alerter-script\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772787 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-node-log\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772825 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-bin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772833 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-netd\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772895 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.772950 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-netns\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773022 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cnibin\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773112 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc270e88-39fa-4781-966a-36f26b64340e-konnectivity-ca\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773134 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-config\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773152 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c69570d-a54a-4d3c-993e-262b21ce1b2a-host-slash\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773169 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-var-lib-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773191 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-script-lib\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773206 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773220 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-multus\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773233 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8824dd66-c4e0-4bc5-86b8-8819373b88d8-hosts-file\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773251 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-etc-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773260 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c69570d-a54a-4d3c-993e-262b21ce1b2a-iptables-alerter-script\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773329 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-bin\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774116 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773280 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-host-cni-bin\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773485 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-k8s-cni-cncf-io\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773497 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-cni-binary-copy\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773516 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-hostroot\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773561 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-k8s-cni-cncf-io\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773565 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-hostroot\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773621 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-multus-certs\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773643 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-multus-cni-dir\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-run-multus-certs\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773693 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c69570d-a54a-4d3c-993e-262b21ce1b2a-host-slash\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773696 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-config\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773739 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-var-lib-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773774 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f753fd6-6a03-4817-9e99-29a3525dbf1e-etc-openvswitch\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773797 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8824dd66-c4e0-4bc5-86b8-8819373b88d8-hosts-file\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773802 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-host-var-lib-cni-multus\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.773841 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc270e88-39fa-4781-966a-36f26b64340e-konnectivity-ca\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.774577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.774547 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovnkube-script-lib\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.775601 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.775562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f753fd6-6a03-4817-9e99-29a3525dbf1e-ovn-node-metrics-cert\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.776684 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.776663 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc270e88-39fa-4781-966a-36f26b64340e-agent-certs\") pod \"konnectivity-agent-cl2mg\" (UID: \"dc270e88-39fa-4781-966a-36f26b64340e\") " pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.795346 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.795320 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z98j\" (UniqueName: \"kubernetes.io/projected/9c69570d-a54a-4d3c-993e-262b21ce1b2a-kube-api-access-6z98j\") pod \"iptables-alerter-ls8pz\" (UID: \"9c69570d-a54a-4d3c-993e-262b21ce1b2a\") " pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:58.795478 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.795426 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgz4\" (UniqueName: \"kubernetes.io/projected/2e9b1768-b354-48f2-86d3-fc71a5fc0ecf-kube-api-access-rsgz4\") pod \"multus-zhk5d\" (UID: \"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf\") " pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.796795 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.796775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfv6d\" (UniqueName: \"kubernetes.io/projected/1f753fd6-6a03-4817-9e99-29a3525dbf1e-kube-api-access-jfv6d\") pod \"ovnkube-node-kc9kf\" (UID: \"1f753fd6-6a03-4817-9e99-29a3525dbf1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.797052 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.797032 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pdz\" (UniqueName: \"kubernetes.io/projected/8824dd66-c4e0-4bc5-86b8-8819373b88d8-kube-api-access-56pdz\") pod \"node-resolver-qbbz5\" (UID: \"8824dd66-c4e0-4bc5-86b8-8819373b88d8\") " pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.857756 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.857723 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" Apr 24 21:26:58.865076 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.865051 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" Apr 24 21:26:58.873667 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.873645 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7lqt" Apr 24 21:26:58.879274 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.879257 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xglrz" Apr 24 21:26:58.886053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.886034 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:26:58.892580 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.892561 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhk5d" Apr 24 21:26:58.899021 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.899002 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbbz5" Apr 24 21:26:58.906561 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.906513 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:26:58.911652 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:58.911635 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ls8pz" Apr 24 21:26:59.176296 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.175671 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:26:59.176296 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.175815 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:26:59.176296 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.175879 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:00.175860169 +0000 UTC m=+4.030619860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:26:59.268576 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.268547 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cfa15a_8e10_489d_94cd_7b8da6f3b83b.slice/crio-f99dda8a6e6fe15fc30f48c96cd3eeff0b2e6f1184d93c4e540b791d212e8b3b WatchSource:0}: Error finding container f99dda8a6e6fe15fc30f48c96cd3eeff0b2e6f1184d93c4e540b791d212e8b3b: Status 404 returned error can't find the container with id f99dda8a6e6fe15fc30f48c96cd3eeff0b2e6f1184d93c4e540b791d212e8b3b Apr 24 21:26:59.269541 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.269520 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2923cb02_1e0e_472a_860f_e4235540cee0.slice/crio-82d2b152c8173d3ab938357fbed5893f42c5df40c5db6a5b4d813e30b4d3b53c WatchSource:0}: Error finding container 82d2b152c8173d3ab938357fbed5893f42c5df40c5db6a5b4d813e30b4d3b53c: Status 404 returned error can't find the container with id 82d2b152c8173d3ab938357fbed5893f42c5df40c5db6a5b4d813e30b4d3b53c Apr 24 21:26:59.272219 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.272061 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9b1768_b354_48f2_86d3_fc71a5fc0ecf.slice/crio-cddebf87bc34fbabe64fbc141024e435465670d424672322b15944e7a6340dad WatchSource:0}: Error finding container cddebf87bc34fbabe64fbc141024e435465670d424672322b15944e7a6340dad: Status 404 returned error can't find the container with id cddebf87bc34fbabe64fbc141024e435465670d424672322b15944e7a6340dad Apr 24 21:26:59.273825 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.273797 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc270e88_39fa_4781_966a_36f26b64340e.slice/crio-fd4ea2718eb7dbf6da0e600e61d7f5808d909944a70c2d409a6150f5444bedca WatchSource:0}: Error finding container fd4ea2718eb7dbf6da0e600e61d7f5808d909944a70c2d409a6150f5444bedca: Status 404 returned error can't find the container with id fd4ea2718eb7dbf6da0e600e61d7f5808d909944a70c2d409a6150f5444bedca Apr 24 21:26:59.274805 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.274774 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e86ed3_921a_4890_a847_d104835d5b0a.slice/crio-de15cb8be1ca7a2206aace6052bce11efe7353a80ac1d4947abe3a2c1149d911 WatchSource:0}: Error finding container de15cb8be1ca7a2206aace6052bce11efe7353a80ac1d4947abe3a2c1149d911: Status 404 returned error can't find the container with id de15cb8be1ca7a2206aace6052bce11efe7353a80ac1d4947abe3a2c1149d911 Apr 24 21:26:59.276369 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.276217 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c69570d_a54a_4d3c_993e_262b21ce1b2a.slice/crio-31edd460bfc0bf2e13586ee9c3d6706a3a7d458f2ad4709efbc730877bcc1cc9 WatchSource:0}: Error finding container 31edd460bfc0bf2e13586ee9c3d6706a3a7d458f2ad4709efbc730877bcc1cc9: Status 404 returned error can't find the container with id 31edd460bfc0bf2e13586ee9c3d6706a3a7d458f2ad4709efbc730877bcc1cc9 Apr 24 21:26:59.276369 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.276288 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:26:59.276475 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.276427 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:26:59.276475 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.276444 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:26:59.276475 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.276456 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:26:59.276648 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:26:59.276506 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:00.276486863 +0000 UTC m=+4.131246535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:26:59.276648 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.276512 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb385beab_9951_427c_a9de_0bc29fc3a8fe.slice/crio-8c1258e64563dcc534d7432fa49a5ed4543fd15aebd38e6d971e1cda7355b579 WatchSource:0}: Error finding container 8c1258e64563dcc534d7432fa49a5ed4543fd15aebd38e6d971e1cda7355b579: Status 404 returned error can't find the container with id 8c1258e64563dcc534d7432fa49a5ed4543fd15aebd38e6d971e1cda7355b579 Apr 24 21:26:59.277453 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.277331 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f753fd6_6a03_4817_9e99_29a3525dbf1e.slice/crio-994e5d7b643a542f846df79c845b90dc3f915229909f64a3a972e1aef12c9e72 WatchSource:0}: Error finding container 994e5d7b643a542f846df79c845b90dc3f915229909f64a3a972e1aef12c9e72: Status 404 returned error can't find the container with id 994e5d7b643a542f846df79c845b90dc3f915229909f64a3a972e1aef12c9e72 Apr 24 21:26:59.279707 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:26:59.279667 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8824dd66_c4e0_4bc5_86b8_8819373b88d8.slice/crio-91bfb78effbf303d0981169c5f4c3d3d6f6cde9ff1df53a5ed1091788b158064 WatchSource:0}: Error finding container 91bfb78effbf303d0981169c5f4c3d3d6f6cde9ff1df53a5ed1091788b158064: Status 404 returned error can't find the container with id 91bfb78effbf303d0981169c5f4c3d3d6f6cde9ff1df53a5ed1091788b158064 Apr 24 21:26:59.592647 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.592345 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:21:57 +0000 UTC" deadline="2027-12-31 10:33:09.27686004 +0000 UTC" Apr 24 21:26:59.592647 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.592560 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14773h6m9.684306655s" Apr 24 21:26:59.704911 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.704847 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7lqt" event={"ID":"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b","Type":"ContainerStarted","Data":"f99dda8a6e6fe15fc30f48c96cd3eeff0b2e6f1184d93c4e540b791d212e8b3b"} Apr 24 21:26:59.706944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.706849 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbbz5" event={"ID":"8824dd66-c4e0-4bc5-86b8-8819373b88d8","Type":"ContainerStarted","Data":"91bfb78effbf303d0981169c5f4c3d3d6f6cde9ff1df53a5ed1091788b158064"} Apr 24 21:26:59.710478 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.710432 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" event={"ID":"b385beab-9951-427c-a9de-0bc29fc3a8fe","Type":"ContainerStarted","Data":"8c1258e64563dcc534d7432fa49a5ed4543fd15aebd38e6d971e1cda7355b579"} Apr 24 21:26:59.712091 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.712042 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ls8pz" event={"ID":"9c69570d-a54a-4d3c-993e-262b21ce1b2a","Type":"ContainerStarted","Data":"31edd460bfc0bf2e13586ee9c3d6706a3a7d458f2ad4709efbc730877bcc1cc9"} Apr 24 21:26:59.715896 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.715866 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhk5d" event={"ID":"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf","Type":"ContainerStarted","Data":"cddebf87bc34fbabe64fbc141024e435465670d424672322b15944e7a6340dad"} Apr 24 21:26:59.718776 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.718752 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" event={"ID":"dd54af8f80e3b05db4203800e6cae347","Type":"ContainerStarted","Data":"a8b9b5c5dbfc60620e6a5c3f9eb2f5d41b5296109f6e81a04a5f56c0cd6a7960"} Apr 24 21:26:59.722345 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.722309 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"994e5d7b643a542f846df79c845b90dc3f915229909f64a3a972e1aef12c9e72"} Apr 24 21:26:59.729036 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.728988 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerStarted","Data":"de15cb8be1ca7a2206aace6052bce11efe7353a80ac1d4947abe3a2c1149d911"} Apr 24 21:26:59.732089 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.732063 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cl2mg" event={"ID":"dc270e88-39fa-4781-966a-36f26b64340e","Type":"ContainerStarted","Data":"fd4ea2718eb7dbf6da0e600e61d7f5808d909944a70c2d409a6150f5444bedca"} Apr 24 21:26:59.743223 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:26:59.743192 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" event={"ID":"2923cb02-1e0e-472a-860f-e4235540cee0","Type":"ContainerStarted","Data":"82d2b152c8173d3ab938357fbed5893f42c5df40c5db6a5b4d813e30b4d3b53c"} Apr 24 21:27:00.183135 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.183102 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:00.183285 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.183267 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:00.183351 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.183335 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:02.18331498 +0000 UTC m=+6.038074660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:00.284863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.283961 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:00.284863 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.284124 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:27:00.284863 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.284144 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:27:00.284863 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.284156 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:00.284863 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.284215 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:02.28419575 +0000 UTC m=+6.138955433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:00.686818 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.686783 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:00.687290 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.686919 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:00.687290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.687027 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:00.687290 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:00.687128 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:00.754914 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.754876 2571 generic.go:358] "Generic (PLEG): container finished" podID="684f5b9427f067db6bbddee483185b81" containerID="85155a8583b009507e3da5e9154be9fd9e915c38dfc9a527cdebe191efce36af" exitCode=0 Apr 24 21:27:00.755747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.755641 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" event={"ID":"684f5b9427f067db6bbddee483185b81","Type":"ContainerDied","Data":"85155a8583b009507e3da5e9154be9fd9e915c38dfc9a527cdebe191efce36af"} Apr 24 21:27:00.775163 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:00.772559 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-204.ec2.internal" podStartSLOduration=3.772538614 podStartE2EDuration="3.772538614s" podCreationTimestamp="2026-04-24 21:26:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:26:59.734928506 +0000 UTC m=+3.589688197" watchObservedRunningTime="2026-04-24 21:27:00.772538614 +0000 UTC m=+4.627298303" Apr 24 21:27:01.763515 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:01.763478 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" event={"ID":"684f5b9427f067db6bbddee483185b81","Type":"ContainerStarted","Data":"69d836d73da62739080e3260caad657d1aaa93437c9d7756a48cd2196932e6e3"} Apr 24 21:27:02.203375 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:02.203285 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:02.203536 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.203426 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:02.203536 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.203483 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:06.203470318 +0000 UTC m=+10.058229985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:02.303945 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:02.303906 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:02.304110 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.304094 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:27:02.304173 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.304112 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:27:02.304173 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.304125 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:02.304262 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.304184 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:06.304164372 +0000 UTC m=+10.158924045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:02.690347 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:02.687422 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:02.690347 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.687555 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:02.690347 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:02.687953 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:02.690347 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:02.688043 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:04.690639 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:04.690610 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:04.691064 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:04.690750 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:04.691128 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:04.691115 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:04.691241 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:04.691191 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:06.237559 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:06.237523 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:06.237958 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.237700 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:06.237958 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.237766 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:14.237744672 +0000 UTC m=+18.092504357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:06.338074 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:06.338032 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:06.338255 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.338208 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:27:06.338255 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.338223 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:27:06.338255 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.338231 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:06.338412 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.338275 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:14.338262815 +0000 UTC m=+18.193022482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:06.688450 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:06.688414 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:06.688632 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.688525 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:06.689042 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:06.689019 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:06.689179 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:06.689136 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:08.687677 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:08.687575 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:08.688185 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:08.687717 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:08.688185 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:08.687775 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:08.688185 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:08.687893 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:10.686865 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:10.686821 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:10.687300 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:10.686829 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:10.687300 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:10.686946 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:10.687300 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:10.687045 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:12.687602 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:12.687561 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:12.687602 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:12.687578 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:12.688123 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:12.687718 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:12.688123 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:12.687831 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:14.296300 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:14.296252 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:14.296764 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.296402 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:14.296764 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.296496 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:30.296460783 +0000 UTC m=+34.151220468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:14.396853 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:14.396814 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:14.397037 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.396972 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:27:14.397037 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.396987 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:27:14.397037 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.396997 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:14.397172 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.397051 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:30.39703222 +0000 UTC m=+34.251791887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:14.686746 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:14.686719 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:14.686746 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:14.686731 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:14.686923 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.686820 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:14.686978 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:14.686957 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:16.687361 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.687212 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:16.687837 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:16.687434 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:16.687837 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.687759 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:16.687947 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:16.687845 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:16.791184 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.791156 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"b307dea96bf5113808c4431a72d5d4d556a690b3a9a6c03bf2e94bc455f3c307"} Apr 24 21:27:16.792165 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.792144 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerStarted","Data":"a62c919ba66a8ea8185becc83ded99a37a07bd28ba7d3f4d46e6f64d6b330097"} Apr 24 21:27:16.794172 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.794146 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cl2mg" event={"ID":"dc270e88-39fa-4781-966a-36f26b64340e","Type":"ContainerStarted","Data":"73c556666677f11149e1dfb50f43dcbd2a068cd606627205d3cd8e7010564dfe"} Apr 24 21:27:16.795652 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.795620 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" event={"ID":"2923cb02-1e0e-472a-860f-e4235540cee0","Type":"ContainerStarted","Data":"2952b4e20e6f672acaa681726750d22e1e6241aadb77f35fa7ed49ae88381d16"} Apr 24 21:27:16.796872 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.796845 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7lqt" event={"ID":"d3cfa15a-8e10-489d-94cd-7b8da6f3b83b","Type":"ContainerStarted","Data":"6daa6c8c499c686ed2da0ab292be3a1b38ff1e25be10733ecc727c774266d8d5"} Apr 24 21:27:16.797980 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.797951 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbbz5" event={"ID":"8824dd66-c4e0-4bc5-86b8-8819373b88d8","Type":"ContainerStarted","Data":"2b2c221933522d05fb1a0cdb6140050a57287f37011fbc5bef7f2837818ff300"} Apr 24 21:27:16.799021 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.799001 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" event={"ID":"b385beab-9951-427c-a9de-0bc29fc3a8fe","Type":"ContainerStarted","Data":"562588f10ea4c00528a6f45beed496684cabef4ed5a3c35feae3c774e8150464"} Apr 24 21:27:16.800016 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.800000 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhk5d" event={"ID":"2e9b1768-b354-48f2-86d3-fc71a5fc0ecf","Type":"ContainerStarted","Data":"e182d1b9f6f5ac6a1d21ddd13c153d832e0476df99328ade9f2514ff6fbe1e57"} Apr 24 21:27:16.817234 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.817202 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-204.ec2.internal" podStartSLOduration=19.817191464 podStartE2EDuration="19.817191464s" podCreationTimestamp="2026-04-24 21:26:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:27:01.781015855 +0000 UTC m=+5.635775546" watchObservedRunningTime="2026-04-24 21:27:16.817191464 +0000 UTC m=+20.671951155" Apr 24 21:27:16.866994 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.866954 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7lqt" podStartSLOduration=3.975658115 podStartE2EDuration="20.866942689s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.27055316 +0000 UTC m=+3.125312827" lastFinishedPulling="2026-04-24 21:27:16.161837719 +0000 UTC m=+20.016597401" observedRunningTime="2026-04-24 21:27:16.843619689 +0000 UTC m=+20.698379374" watchObservedRunningTime="2026-04-24 21:27:16.866942689 +0000 UTC m=+20.721702379" Apr 24 21:27:16.867289 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.867261 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zhk5d" podStartSLOduration=3.686156633 podStartE2EDuration="20.867253113s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.274558025 +0000 UTC m=+3.129317707" lastFinishedPulling="2026-04-24 21:27:16.455654504 +0000 UTC m=+20.310414187" observedRunningTime="2026-04-24 21:27:16.866753091 +0000 UTC m=+20.721512780" watchObservedRunningTime="2026-04-24 21:27:16.867253113 +0000 UTC m=+20.722012802" Apr 24 21:27:16.881357 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.881324 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbbz5" podStartSLOduration=3.7415472899999997 podStartE2EDuration="20.881314059s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.281546865 +0000 UTC m=+3.136306534" lastFinishedPulling="2026-04-24 21:27:16.421313622 +0000 UTC m=+20.276073303" observedRunningTime="2026-04-24 21:27:16.881136487 +0000 UTC m=+20.735896177" watchObservedRunningTime="2026-04-24 21:27:16.881314059 +0000 UTC m=+20.736073747" Apr 24 21:27:16.916605 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.916546 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cl2mg" podStartSLOduration=8.377942348 podStartE2EDuration="20.916531826s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.276424696 +0000 UTC m=+3.131184364" lastFinishedPulling="2026-04-24 21:27:11.815014174 +0000 UTC m=+15.669773842" observedRunningTime="2026-04-24 21:27:16.91609914 +0000 UTC m=+20.770858830" watchObservedRunningTime="2026-04-24 21:27:16.916531826 +0000 UTC m=+20.771291517" Apr 24 21:27:16.917412 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:16.917380 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mt7m9" podStartSLOduration=3.774382286 podStartE2EDuration="20.917367775s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.27833746 +0000 UTC m=+3.133097138" lastFinishedPulling="2026-04-24 21:27:16.421322954 +0000 UTC m=+20.276082627" observedRunningTime="2026-04-24 21:27:16.897397539 +0000 UTC m=+20.752157227" watchObservedRunningTime="2026-04-24 21:27:16.917367775 +0000 UTC m=+20.772127464" Apr 24 21:27:17.805740 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.805508 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806067 2571 generic.go:358] "Generic (PLEG): container finished" podID="1f753fd6-6a03-4817-9e99-29a3525dbf1e" containerID="a62f5a072e644c9f0171cc5bb0c692a9e8770f1dae3d9f7031775000402e7593" exitCode=1 Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806137 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"b12e9423816317e71b4a7aca6d0ccda6386fbb4f2d022e6f33bb660032130d89"} Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806170 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"08fdc122b264b88372e4073e6ebe923ce00832e059baf301cc15ae3916a90707"} Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806179 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"3a514aa3ba1d6081591e0c0ed3ab494cf8183ca95613da5a4b395b60978bc14d"} Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806188 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"3f13556b314c7652caaeb89793b77a29f2248b96be582dbfc7612dff37fb8334"} Apr 24 21:27:17.806389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.806200 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerDied","Data":"a62f5a072e644c9f0171cc5bb0c692a9e8770f1dae3d9f7031775000402e7593"} Apr 24 21:27:17.807721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.807697 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="a62c919ba66a8ea8185becc83ded99a37a07bd28ba7d3f4d46e6f64d6b330097" exitCode=0 Apr 24 21:27:17.808616 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.808578 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"a62c919ba66a8ea8185becc83ded99a37a07bd28ba7d3f4d46e6f64d6b330097"} Apr 24 21:27:17.876995 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:17.876967 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 24 21:27:18.638843 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.638722 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-24T21:27:17.876988304Z","UUID":"e4a299c0-43fa-42d1-aebd-7fec655ca4eb","Handler":null,"Name":"","Endpoint":""} Apr 24 21:27:18.640660 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.640638 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 24 21:27:18.640790 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.640669 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 24 21:27:18.686818 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.686784 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:18.686985 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:18.686904 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:18.686985 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.686936 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:18.687153 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:18.687045 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:18.812260 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.812208 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" event={"ID":"2923cb02-1e0e-472a-860f-e4235540cee0","Type":"ContainerStarted","Data":"f9954ce8b4c506dc106c5675265dbfebf306bee77b7133a0ae5dc7e8d2575d6f"} Apr 24 21:27:18.813699 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.813670 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ls8pz" event={"ID":"9c69570d-a54a-4d3c-993e-262b21ce1b2a","Type":"ContainerStarted","Data":"4a5304e1dea89abf335ac94bccfbd24d2a7778c01b7a02d82f7675fb9b8be691"} Apr 24 21:27:18.830468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:18.830418 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ls8pz" podStartSLOduration=5.68643729 podStartE2EDuration="22.830403279s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.27743706 +0000 UTC m=+3.132196726" lastFinishedPulling="2026-04-24 21:27:16.421403048 +0000 UTC m=+20.276162715" observedRunningTime="2026-04-24 21:27:18.830023072 +0000 UTC m=+22.684782761" watchObservedRunningTime="2026-04-24 21:27:18.830403279 +0000 UTC m=+22.685162968" Apr 24 21:27:19.367250 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.367030 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:27:19.367943 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.367922 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:27:19.818228 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.818200 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:27:19.818703 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.818620 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"88ceb34aefc46e0f214ff186ab56759b3a47ced4498f65ca3120b5dc527b344d"} Apr 24 21:27:19.820497 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.820467 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" event={"ID":"2923cb02-1e0e-472a-860f-e4235540cee0","Type":"ContainerStarted","Data":"ef271a751b9aad870c6acf2af9d2ddf8374fdd16f8854e47ee06fef68ebf8961"} Apr 24 21:27:19.821036 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.820855 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:27:19.821178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.821159 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cl2mg" Apr 24 21:27:19.856787 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:19.856744 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwgzr" podStartSLOduration=4.207008298 podStartE2EDuration="23.856731274s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.27149564 +0000 UTC m=+3.126255306" lastFinishedPulling="2026-04-24 21:27:18.921218612 +0000 UTC m=+22.775978282" observedRunningTime="2026-04-24 21:27:19.85655206 +0000 UTC m=+23.711311750" watchObservedRunningTime="2026-04-24 21:27:19.856731274 +0000 UTC m=+23.711490960" Apr 24 21:27:20.687345 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:20.687264 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:20.687345 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:20.687324 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:20.687615 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:20.687413 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:20.687615 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:20.687550 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:22.686945 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.686757 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:22.687640 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.686762 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:22.687640 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:22.687014 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:22.687640 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:22.687082 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:22.829673 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.829641 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:27:22.829982 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.829941 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"56c47aaa317a04ac867f4ef58f767f9bbf21d1a3da93f92d0512563b0c72d8ee"} Apr 24 21:27:22.832480 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.830707 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:22.832480 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.830992 2571 scope.go:117] "RemoveContainer" containerID="a62f5a072e644c9f0171cc5bb0c692a9e8770f1dae3d9f7031775000402e7593" Apr 24 21:27:22.834294 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.834267 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="a936c1280692a58fdcc316b6f1fdd91265464707d84d229dc56a054c9a8e4d58" exitCode=0 Apr 24 21:27:22.834374 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.834322 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"a936c1280692a58fdcc316b6f1fdd91265464707d84d229dc56a054c9a8e4d58"} Apr 24 21:27:22.848791 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:22.848771 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:23.841549 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.841523 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:27:23.842043 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.841871 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" event={"ID":"1f753fd6-6a03-4817-9e99-29a3525dbf1e","Type":"ContainerStarted","Data":"18d255816028451965b88d3ba0378214ba3587ee0de4073ae1e274068dc43288"} Apr 24 21:27:23.842043 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.842032 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Apr 24 21:27:23.842273 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.842253 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:23.843923 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.843901 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="f58f7f2ebd5eb17c6a69d18fee1b2ff30d3c661d28b4413a9e77509a0101703d" exitCode=0 Apr 24 21:27:23.844035 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.843927 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"f58f7f2ebd5eb17c6a69d18fee1b2ff30d3c661d28b4413a9e77509a0101703d"} Apr 24 21:27:23.857154 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.857133 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:23.924649 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:23.924602 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" podStartSLOduration=10.696808709 podStartE2EDuration="27.924572686s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.280265494 +0000 UTC m=+3.135025161" lastFinishedPulling="2026-04-24 21:27:16.508029456 +0000 UTC m=+20.362789138" observedRunningTime="2026-04-24 21:27:23.891836847 +0000 UTC m=+27.746596535" watchObservedRunningTime="2026-04-24 21:27:23.924572686 +0000 UTC m=+27.779332374" Apr 24 21:27:24.687336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:24.687252 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:24.687336 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:24.687280 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:24.687616 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:24.687393 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:24.687616 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:24.687521 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:24.850143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:24.850109 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="973b8d856d2f0700f64ab0b10f6c13e2ac3078e7e54a3e593fe19ae0d2494ede" exitCode=0 Apr 24 21:27:24.850474 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:24.850191 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"973b8d856d2f0700f64ab0b10f6c13e2ac3078e7e54a3e593fe19ae0d2494ede"} Apr 24 21:27:24.850474 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:24.850388 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Apr 24 21:27:25.852618 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:25.852579 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Apr 24 21:27:26.468475 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.468442 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:26.480561 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.480503 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" podUID="1f753fd6-6a03-4817-9e99-29a3525dbf1e" containerName="ovnkube-controller" probeResult="failure" output="" Apr 24 21:27:26.490351 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.490319 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" podUID="1f753fd6-6a03-4817-9e99-29a3525dbf1e" containerName="ovnkube-controller" probeResult="failure" output="" Apr 24 21:27:26.688100 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.688070 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:26.688247 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:26.688172 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:26.688329 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.688259 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:26.688386 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:26.688367 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:26.865120 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:26.865043 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" podUID="1f753fd6-6a03-4817-9e99-29a3525dbf1e" containerName="ovnkube-controller" probeResult="failure" output="" Apr 24 21:27:28.686796 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:28.686754 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:28.687230 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:28.686883 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:28.687307 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:28.686756 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:28.687385 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:28.687345 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:30.319845 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:30.319812 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:30.320357 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.320340 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:30.320411 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.320401 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs podName:7151d443-18e1-458e-a1d5-d2536594c786 nodeName:}" failed. No retries permitted until 2026-04-24 21:28:02.320386633 +0000 UTC m=+66.175146299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs") pod "network-metrics-daemon-4h277" (UID: "7151d443-18e1-458e-a1d5-d2536594c786") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:27:30.420792 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:30.420757 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:30.420934 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.420902 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:27:30.420934 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.420923 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:27:30.420934 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.420932 2571 projected.go:194] Error preparing data for projected volume kube-api-access-rbqm6 for pod openshift-network-diagnostics/network-check-target-ztccj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:30.421049 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.420980 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6 podName:8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9 nodeName:}" failed. No retries permitted until 2026-04-24 21:28:02.420966634 +0000 UTC m=+66.275726301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbqm6" (UniqueName: "kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6") pod "network-check-target-ztccj" (UID: "8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:27:30.686677 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:30.686649 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:30.686783 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:30.686656 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:30.686783 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.686747 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:30.686862 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:30.686836 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:30.864257 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:30.864214 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerStarted","Data":"71cfb700fb3caa097b1c102dd30abdf89242d18e260d98a1530da1dcecb82dc3"} Apr 24 21:27:31.868198 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:31.868014 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="71cfb700fb3caa097b1c102dd30abdf89242d18e260d98a1530da1dcecb82dc3" exitCode=0 Apr 24 21:27:31.868681 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:31.868099 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"71cfb700fb3caa097b1c102dd30abdf89242d18e260d98a1530da1dcecb82dc3"} Apr 24 21:27:32.687283 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:32.687256 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:32.687459 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:32.687264 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:32.687459 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:32.687362 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:32.687459 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:32.687420 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:32.872577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:32.872547 2571 generic.go:358] "Generic (PLEG): container finished" podID="45e86ed3-921a-4890-a847-d104835d5b0a" containerID="207c2c2b6cfff417a82e3d02e1b608407d22658a609676c1390bfb43fc25fffd" exitCode=0 Apr 24 21:27:32.873037 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:32.872610 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerDied","Data":"207c2c2b6cfff417a82e3d02e1b608407d22658a609676c1390bfb43fc25fffd"} Apr 24 21:27:33.876508 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:33.876476 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xglrz" event={"ID":"45e86ed3-921a-4890-a847-d104835d5b0a","Type":"ContainerStarted","Data":"4eb7011b1b61460ddbaa933bd4ae03ba16f4761bdc00d6e4ca889fdf93fe9f99"} Apr 24 21:27:33.901315 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:33.901249 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xglrz" podStartSLOduration=6.625921362 podStartE2EDuration="37.90122516s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:26:59.277840141 +0000 UTC m=+3.132599807" lastFinishedPulling="2026-04-24 21:27:30.553143938 +0000 UTC m=+34.407903605" observedRunningTime="2026-04-24 21:27:33.901213259 +0000 UTC m=+37.755972947" watchObservedRunningTime="2026-04-24 21:27:33.90122516 +0000 UTC m=+37.755984840" Apr 24 21:27:34.687266 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:34.687232 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:34.687434 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:34.687232 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:34.687434 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:34.687321 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:34.687434 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:34.687414 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:35.759779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:35.759742 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4h277"] Apr 24 21:27:35.760537 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:35.759869 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:35.760537 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:35.759996 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:35.762154 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:35.762128 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztccj"] Apr 24 21:27:35.762271 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:35.762203 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:35.762342 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:35.762277 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:37.687280 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:37.687246 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:37.687280 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:37.687270 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:37.687812 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:37.687367 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztccj" podUID="8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9" Apr 24 21:27:37.687812 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:37.687499 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h277" podUID="7151d443-18e1-458e-a1d5-d2536594c786" Apr 24 21:27:39.453856 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.453826 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-204.ec2.internal" event="NodeReady" Apr 24 21:27:39.454208 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.453960 2571 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 24 21:27:39.512308 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.512281 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2n844"] Apr 24 21:27:39.515886 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.515858 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.518044 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.518015 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2rbj"] Apr 24 21:27:39.518986 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.518966 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 24 21:27:39.519102 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.519038 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 24 21:27:39.519629 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.519612 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.519718 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.519647 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85klr\"" Apr 24 21:27:39.523956 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.523716 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 24 21:27:39.523956 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.523795 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 24 21:27:39.523956 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.523953 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 24 21:27:39.524120 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.523961 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 24 21:27:39.524120 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.524073 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 24 21:27:39.524337 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.524322 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fgjf8\"" Apr 24 21:27:39.530451 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.530432 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2n844"] Apr 24 21:27:39.535081 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.535062 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2rbj"] Apr 24 21:27:39.623449 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.623374 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qd6ql"] Apr 24 21:27:39.624935 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.624922 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.630831 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.630812 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 24 21:27:39.630952 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.630908 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfvbj\"" Apr 24 21:27:39.631210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.631186 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 24 21:27:39.642836 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.642816 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qd6ql"] Apr 24 21:27:39.687350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.687323 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:27:39.687461 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.687323 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:27:39.689688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689658 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/039f54e2-67cf-4236-b46b-973bc566ac65-cert\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.689850 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689703 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.689850 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689724 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-data-volume\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.689850 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689768 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg686\" (UniqueName: \"kubernetes.io/projected/039f54e2-67cf-4236-b46b-973bc566ac65-kube-api-access-tg686\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.689850 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689816 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv5tr\" (UniqueName: \"kubernetes.io/projected/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-api-access-rv5tr\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.690006 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689875 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.690006 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.689924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-crio-socket\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.693859 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.693838 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vd7zr\"" Apr 24 21:27:39.693937 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.693880 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 21:27:39.694172 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.694157 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 21:27:39.694236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.694156 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9lwz\"" Apr 24 21:27:39.694740 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.694724 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 21:27:39.790427 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790386 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5rr\" (UniqueName: \"kubernetes.io/projected/12b376f6-af4e-43f7-aabc-502f414235d5-kube-api-access-sd5rr\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.790427 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790425 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12b376f6-af4e-43f7-aabc-502f414235d5-config-volume\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790454 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/039f54e2-67cf-4236-b46b-973bc566ac65-cert\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790523 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790555 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-data-volume\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790572 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg686\" (UniqueName: \"kubernetes.io/projected/039f54e2-67cf-4236-b46b-973bc566ac65-kube-api-access-tg686\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790636 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv5tr\" (UniqueName: \"kubernetes.io/projected/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-api-access-rv5tr\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.790688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12b376f6-af4e-43f7-aabc-502f414235d5-metrics-tls\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.790944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790709 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.790944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790753 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-crio-socket\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.791109 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12b376f6-af4e-43f7-aabc-502f414235d5-tmp-dir\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.791163 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.790903 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-data-volume\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.791212 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.791021 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-crio-socket\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.791351 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.791332 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.794708 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.794680 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.794903 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.794885 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/039f54e2-67cf-4236-b46b-973bc566ac65-cert\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.813144 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.813125 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv5tr\" (UniqueName: \"kubernetes.io/projected/cb5e203f-2bca-4bd1-bd9f-519d859bd9ed-kube-api-access-rv5tr\") pod \"insights-runtime-extractor-2n844\" (UID: \"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed\") " pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.816081 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.816063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg686\" (UniqueName: \"kubernetes.io/projected/039f54e2-67cf-4236-b46b-973bc566ac65-kube-api-access-tg686\") pod \"ingress-canary-x2rbj\" (UID: \"039f54e2-67cf-4236-b46b-973bc566ac65\") " pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.826841 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.826825 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2n844" Apr 24 21:27:39.832511 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.832496 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2rbj" Apr 24 21:27:39.891674 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.891485 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12b376f6-af4e-43f7-aabc-502f414235d5-metrics-tls\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.891674 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.891560 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12b376f6-af4e-43f7-aabc-502f414235d5-tmp-dir\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.891674 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.891623 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5rr\" (UniqueName: \"kubernetes.io/projected/12b376f6-af4e-43f7-aabc-502f414235d5-kube-api-access-sd5rr\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.891674 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.891652 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12b376f6-af4e-43f7-aabc-502f414235d5-config-volume\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.892054 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.892031 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12b376f6-af4e-43f7-aabc-502f414235d5-tmp-dir\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.892340 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.892224 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12b376f6-af4e-43f7-aabc-502f414235d5-config-volume\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.895784 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.895750 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12b376f6-af4e-43f7-aabc-502f414235d5-metrics-tls\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.916677 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.916477 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5rr\" (UniqueName: \"kubernetes.io/projected/12b376f6-af4e-43f7-aabc-502f414235d5-kube-api-access-sd5rr\") pod \"dns-default-qd6ql\" (UID: \"12b376f6-af4e-43f7-aabc-502f414235d5\") " pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.932951 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.932894 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:39.966860 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.966828 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2n844"] Apr 24 21:27:39.969721 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:39.969642 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5e203f_2bca_4bd1_bd9f_519d859bd9ed.slice/crio-f4db263665fe57d81ed245aa9d64262c82b8558ddb2820486ffe26285c2ff1b4 WatchSource:0}: Error finding container f4db263665fe57d81ed245aa9d64262c82b8558ddb2820486ffe26285c2ff1b4: Status 404 returned error can't find the container with id f4db263665fe57d81ed245aa9d64262c82b8558ddb2820486ffe26285c2ff1b4 Apr 24 21:27:39.971781 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:39.971745 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2rbj"] Apr 24 21:27:39.976199 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:39.976178 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039f54e2_67cf_4236_b46b_973bc566ac65.slice/crio-97e9981bdf1afc388ca0d8e28594cafd9de1ccc13af1a53c26dccc3b70ed8caf WatchSource:0}: Error finding container 97e9981bdf1afc388ca0d8e28594cafd9de1ccc13af1a53c26dccc3b70ed8caf: Status 404 returned error can't find the container with id 97e9981bdf1afc388ca0d8e28594cafd9de1ccc13af1a53c26dccc3b70ed8caf Apr 24 21:27:40.054931 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.054900 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qd6ql"] Apr 24 21:27:40.059009 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:40.058982 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b376f6_af4e_43f7_aabc_502f414235d5.slice/crio-36114ff56687fae464f6006ba505e187a65c8936f637666a7d033e4970df31db WatchSource:0}: Error finding container 36114ff56687fae464f6006ba505e187a65c8936f637666a7d033e4970df31db: Status 404 returned error can't find the container with id 36114ff56687fae464f6006ba505e187a65c8936f637666a7d033e4970df31db Apr 24 21:27:40.891106 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.890775 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd6ql" event={"ID":"12b376f6-af4e-43f7-aabc-502f414235d5","Type":"ContainerStarted","Data":"36114ff56687fae464f6006ba505e187a65c8936f637666a7d033e4970df31db"} Apr 24 21:27:40.892448 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.892415 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2rbj" event={"ID":"039f54e2-67cf-4236-b46b-973bc566ac65","Type":"ContainerStarted","Data":"97e9981bdf1afc388ca0d8e28594cafd9de1ccc13af1a53c26dccc3b70ed8caf"} Apr 24 21:27:40.894214 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.894185 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2n844" event={"ID":"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed","Type":"ContainerStarted","Data":"5ba5607fbef25df0398f00c457b70fca4701b30ca0e688c46d7c523b55a77698"} Apr 24 21:27:40.894214 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.894220 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2n844" event={"ID":"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed","Type":"ContainerStarted","Data":"cac5254a08cb83e3b50c1dff945cd9f65f35460ea159f14373f212cdd134a3af"} Apr 24 21:27:40.894381 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:40.894230 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2n844" event={"ID":"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed","Type":"ContainerStarted","Data":"f4db263665fe57d81ed245aa9d64262c82b8558ddb2820486ffe26285c2ff1b4"} Apr 24 21:27:42.230744 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.230713 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gnkc9"] Apr 24 21:27:42.249242 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.249154 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gnkc9"] Apr 24 21:27:42.249378 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.249283 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.251938 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.251912 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 24 21:27:42.252102 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.251939 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 24 21:27:42.252102 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.251948 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 24 21:27:42.252243 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.252214 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 24 21:27:42.253062 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.253043 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 24 21:27:42.253062 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.253052 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2ldqs\"" Apr 24 21:27:42.410967 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.410930 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1474a03a-58fc-4835-bcfd-fa1e9f746678-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.411147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.410982 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzrgj\" (UniqueName: \"kubernetes.io/projected/1474a03a-58fc-4835-bcfd-fa1e9f746678-kube-api-access-wzrgj\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.411147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.411031 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.411147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.411065 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.512044 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.511966 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.512044 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.512020 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.512237 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.512087 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1474a03a-58fc-4835-bcfd-fa1e9f746678-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.512237 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.512130 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzrgj\" (UniqueName: \"kubernetes.io/projected/1474a03a-58fc-4835-bcfd-fa1e9f746678-kube-api-access-wzrgj\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.512237 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:42.512196 2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Apr 24 21:27:42.512397 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:42.512265 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls podName:1474a03a-58fc-4835-bcfd-fa1e9f746678 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:43.012247212 +0000 UTC m=+46.867006878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls") pod "prometheus-operator-5676c8c784-gnkc9" (UID: "1474a03a-58fc-4835-bcfd-fa1e9f746678") : secret "prometheus-operator-tls" not found Apr 24 21:27:42.512830 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.512805 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1474a03a-58fc-4835-bcfd-fa1e9f746678-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.516408 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.516368 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:42.522547 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:42.522521 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzrgj\" (UniqueName: \"kubernetes.io/projected/1474a03a-58fc-4835-bcfd-fa1e9f746678-kube-api-access-wzrgj\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:43.016530 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.016493 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:43.019014 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.018994 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1474a03a-58fc-4835-bcfd-fa1e9f746678-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gnkc9\" (UID: \"1474a03a-58fc-4835-bcfd-fa1e9f746678\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:43.158471 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.158440 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" Apr 24 21:27:43.444236 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.444215 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gnkc9"] Apr 24 21:27:43.447515 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:43.447483 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1474a03a_58fc_4835_bcfd_fa1e9f746678.slice/crio-d25c98ddff496d1ec8fde98d225d1876aa4dd9226336e8082dcfcd5cfe89bb11 WatchSource:0}: Error finding container d25c98ddff496d1ec8fde98d225d1876aa4dd9226336e8082dcfcd5cfe89bb11: Status 404 returned error can't find the container with id d25c98ddff496d1ec8fde98d225d1876aa4dd9226336e8082dcfcd5cfe89bb11 Apr 24 21:27:43.771271 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.771081 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:27:43.786491 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.786431 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:27:43.786613 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.786537 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790727 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bdp6p\"" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790756 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790782 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790843 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790755 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 24 21:27:43.790976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.790786 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 24 21:27:43.791339 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.791136 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 24 21:27:43.791339 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.791270 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 24 21:27:43.821550 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.821704 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821562 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.821704 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821618 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.821704 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821634 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.821704 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821666 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpdlg\" (UniqueName: \"kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.821837 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.821747 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.901600 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.901555 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2rbj" event={"ID":"039f54e2-67cf-4236-b46b-973bc566ac65","Type":"ContainerStarted","Data":"dd49bcf107fe633dff26794eed864bce3a95e8c726a65b962a7dfa11f5ab5bf9"} Apr 24 21:27:43.903219 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.903193 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd6ql" event={"ID":"12b376f6-af4e-43f7-aabc-502f414235d5","Type":"ContainerStarted","Data":"675e1c3dcf8239779cbcad6777f20aec8dc89ebc2898a0ebcd7ecd7de31a60ab"} Apr 24 21:27:43.903340 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.903224 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qd6ql" event={"ID":"12b376f6-af4e-43f7-aabc-502f414235d5","Type":"ContainerStarted","Data":"be21ca40561752e3cbfee8c251ca5c96fedfd4a6733885d4ecb3db6129eb337d"} Apr 24 21:27:43.903340 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.903297 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:43.906263 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.906243 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" event={"ID":"1474a03a-58fc-4835-bcfd-fa1e9f746678","Type":"ContainerStarted","Data":"d25c98ddff496d1ec8fde98d225d1876aa4dd9226336e8082dcfcd5cfe89bb11"} Apr 24 21:27:43.908202 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.908183 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2n844" event={"ID":"cb5e203f-2bca-4bd1-bd9f-519d859bd9ed","Type":"ContainerStarted","Data":"da293c4f2b15580cc1dba488d04fc36b0f759585a76b9e0fb19a48be3f597679"} Apr 24 21:27:43.920184 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.920142 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2rbj" podStartSLOduration=1.608318309 podStartE2EDuration="4.920131767s" podCreationTimestamp="2026-04-24 21:27:39 +0000 UTC" firstStartedPulling="2026-04-24 21:27:39.979509929 +0000 UTC m=+43.834269597" lastFinishedPulling="2026-04-24 21:27:43.291323378 +0000 UTC m=+47.146083055" observedRunningTime="2026-04-24 21:27:43.919279284 +0000 UTC m=+47.774038986" watchObservedRunningTime="2026-04-24 21:27:43.920131767 +0000 UTC m=+47.774891488" Apr 24 21:27:43.922202 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922187 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpdlg\" (UniqueName: \"kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.922259 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922241 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.922319 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922294 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.922371 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922348 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.922419 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922405 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.922457 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.922426 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.923070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.923033 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.923312 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.923294 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.925838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.925822 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.925940 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.925923 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.939334 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.939288 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2n844" podStartSLOduration=1.70479944 podStartE2EDuration="4.939273587s" podCreationTimestamp="2026-04-24 21:27:39 +0000 UTC" firstStartedPulling="2026-04-24 21:27:40.058411757 +0000 UTC m=+43.913171424" lastFinishedPulling="2026-04-24 21:27:43.292885904 +0000 UTC m=+47.147645571" observedRunningTime="2026-04-24 21:27:43.938271892 +0000 UTC m=+47.793031581" watchObservedRunningTime="2026-04-24 21:27:43.939273587 +0000 UTC m=+47.794033283" Apr 24 21:27:43.941851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.941831 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpdlg\" (UniqueName: \"kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.944811 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.944792 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config\") pod \"console-76cbc8bc9f-jl2jn\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:43.955102 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:43.955064 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qd6ql" podStartSLOduration=1.7245331 podStartE2EDuration="4.955051513s" podCreationTimestamp="2026-04-24 21:27:39 +0000 UTC" firstStartedPulling="2026-04-24 21:27:40.060806926 +0000 UTC m=+43.915566597" lastFinishedPulling="2026-04-24 21:27:43.291325324 +0000 UTC m=+47.146085010" observedRunningTime="2026-04-24 21:27:43.954910657 +0000 UTC m=+47.809670347" watchObservedRunningTime="2026-04-24 21:27:43.955051513 +0000 UTC m=+47.809811204" Apr 24 21:27:44.096208 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:44.096131 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:44.237146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:44.237114 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:27:44.241554 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:44.241517 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6f3edc_32c2_4a37_907c_b2d401989ea5.slice/crio-e1e394a4d80d96163c1c08b85f41e4a36572ac7505af1019c29189cfd132165a WatchSource:0}: Error finding container e1e394a4d80d96163c1c08b85f41e4a36572ac7505af1019c29189cfd132165a: Status 404 returned error can't find the container with id e1e394a4d80d96163c1c08b85f41e4a36572ac7505af1019c29189cfd132165a Apr 24 21:27:44.911818 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:44.911784 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbc8bc9f-jl2jn" event={"ID":"7e6f3edc-32c2-4a37-907c-b2d401989ea5","Type":"ContainerStarted","Data":"e1e394a4d80d96163c1c08b85f41e4a36572ac7505af1019c29189cfd132165a"} Apr 24 21:27:45.919004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:45.918753 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" event={"ID":"1474a03a-58fc-4835-bcfd-fa1e9f746678","Type":"ContainerStarted","Data":"a761ae8644b0b41d60e1c9203b5112a729648da4260f84f59ae0b3530eb45a03"} Apr 24 21:27:45.919535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:45.919012 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" event={"ID":"1474a03a-58fc-4835-bcfd-fa1e9f746678","Type":"ContainerStarted","Data":"32d623ad6b9a5a447e1f21b1cede67ef2fea81d40968a3ea823ead0b1b547b10"} Apr 24 21:27:45.941965 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:45.941912 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-gnkc9" podStartSLOduration=2.272323749 podStartE2EDuration="3.941895441s" podCreationTimestamp="2026-04-24 21:27:42 +0000 UTC" firstStartedPulling="2026-04-24 21:27:43.44978543 +0000 UTC m=+47.304545098" lastFinishedPulling="2026-04-24 21:27:45.119357122 +0000 UTC m=+48.974116790" observedRunningTime="2026-04-24 21:27:45.940810242 +0000 UTC m=+49.795569932" watchObservedRunningTime="2026-04-24 21:27:45.941895441 +0000 UTC m=+49.796655133" Apr 24 21:27:47.652035 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.652002 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx"] Apr 24 21:27:47.667622 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.667574 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.668555 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.668533 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx"] Apr 24 21:27:47.670333 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.670314 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 24 21:27:47.671633 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.671613 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 24 21:27:47.671747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.671673 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mffl\"" Apr 24 21:27:47.679788 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.679763 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xdcwr"] Apr 24 21:27:47.692253 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.692234 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-96br4"] Apr 24 21:27:47.692421 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.692404 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.694949 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.694918 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 24 21:27:47.695202 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.695185 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8r446\"" Apr 24 21:27:47.695422 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.695406 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 24 21:27:47.695621 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.695580 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 24 21:27:47.711157 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.711135 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xdcwr"] Apr 24 21:27:47.711262 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.711246 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.715922 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.715897 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 24 21:27:47.716110 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.716086 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 24 21:27:47.716260 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.716243 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lx6q7\"" Apr 24 21:27:47.716389 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.716374 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 24 21:27:47.747656 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-tls\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.747748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747659 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-textfile\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.747748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747677 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3136303c-3def-4820-b28c-3092f1fb77db-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.747748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747700 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.747861 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.747861 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.747861 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747799 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-wtmp\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.747861 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747833 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf75630-71d7-404a-ad07-83f3fe8a8540-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.747861 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747855 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.748030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-metrics-client-ca\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.748030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747953 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmmt\" (UniqueName: \"kubernetes.io/projected/d8efd1be-eab8-42f7-8480-05613c349abf-kube-api-access-5vmmt\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.748030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-root\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.748030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.747998 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.748030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-accelerators-collector-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.748192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748056 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-sys\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.748192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748086 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfpjf\" (UniqueName: \"kubernetes.io/projected/3136303c-3def-4820-b28c-3092f1fb77db-kube-api-access-jfpjf\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.748192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748117 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.748192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748137 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgrk\" (UniqueName: \"kubernetes.io/projected/1cf75630-71d7-404a-ad07-83f3fe8a8540-kube-api-access-dcgrk\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.748192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.748153 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.848952 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.848925 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf75630-71d7-404a-ad07-83f3fe8a8540-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.849085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.848959 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.848990 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-metrics-client-ca\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849006 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmmt\" (UniqueName: \"kubernetes.io/projected/d8efd1be-eab8-42f7-8480-05613c349abf-kube-api-access-5vmmt\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849021 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-root\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849038 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849318 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849112 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-root\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849318 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849158 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-accelerators-collector-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849318 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849213 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-sys\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849318 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849250 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfpjf\" (UniqueName: \"kubernetes.io/projected/3136303c-3def-4820-b28c-3092f1fb77db-kube-api-access-jfpjf\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849318 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849279 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849324 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-sys\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849398 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgrk\" (UniqueName: \"kubernetes.io/projected/1cf75630-71d7-404a-ad07-83f3fe8a8540-kube-api-access-dcgrk\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849436 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849478 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-tls\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849511 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-textfile\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849560 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849540 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3136303c-3def-4820-b28c-3092f1fb77db-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849575 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849622 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849662 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849690 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-wtmp\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849756 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849781 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf75630-71d7-404a-ad07-83f3fe8a8540-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.849863 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849795 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-accelerators-collector-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.850147 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:47.849889 2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Apr 24 21:27:47.850147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.849894 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-wtmp\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.850147 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:27:47.849968 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls podName:1cf75630-71d7-404a-ad07-83f3fe8a8540 nodeName:}" failed. No retries permitted until 2026-04-24 21:27:48.349946101 +0000 UTC m=+52.204705770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls") pod "openshift-state-metrics-9d44df66c-wxblx" (UID: "1cf75630-71d7-404a-ad07-83f3fe8a8540") : secret "openshift-state-metrics-tls" not found Apr 24 21:27:47.850147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.850039 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-textfile\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.850406 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.850381 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3136303c-3def-4820-b28c-3092f1fb77db-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.850524 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.850504 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3136303c-3def-4820-b28c-3092f1fb77db-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.853117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.853093 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.853215 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.853155 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.853215 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.853162 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8efd1be-eab8-42f7-8480-05613c349abf-node-exporter-tls\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.853300 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.853235 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.853376 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.853357 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3136303c-3def-4820-b28c-3092f1fb77db-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.862648 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.862625 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmmt\" (UniqueName: \"kubernetes.io/projected/d8efd1be-eab8-42f7-8480-05613c349abf-kube-api-access-5vmmt\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:47.863005 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.862989 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfpjf\" (UniqueName: \"kubernetes.io/projected/3136303c-3def-4820-b28c-3092f1fb77db-kube-api-access-jfpjf\") pod \"kube-state-metrics-69db897b98-xdcwr\" (UID: \"3136303c-3def-4820-b28c-3092f1fb77db\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:47.863601 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.863568 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgrk\" (UniqueName: \"kubernetes.io/projected/1cf75630-71d7-404a-ad07-83f3fe8a8540-kube-api-access-dcgrk\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:47.870474 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:47.870457 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8efd1be-eab8-42f7-8480-05613c349abf-metrics-client-ca\") pod \"node-exporter-96br4\" (UID: \"d8efd1be-eab8-42f7-8480-05613c349abf\") " pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:48.003035 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.002937 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" Apr 24 21:27:48.023384 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.023357 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96br4" Apr 24 21:27:48.031925 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:48.031888 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8efd1be_eab8_42f7_8480_05613c349abf.slice/crio-0a241ed684aab3a718f15a8bc1996666ee7826c93d216617328fb1d8a7f0f4ea WatchSource:0}: Error finding container 0a241ed684aab3a718f15a8bc1996666ee7826c93d216617328fb1d8a7f0f4ea: Status 404 returned error can't find the container with id 0a241ed684aab3a718f15a8bc1996666ee7826c93d216617328fb1d8a7f0f4ea Apr 24 21:27:48.128330 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.128164 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xdcwr"] Apr 24 21:27:48.132482 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:48.132444 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3136303c_3def_4820_b28c_3092f1fb77db.slice/crio-5fb23b4ed9e37e028930743ab989b66444e1e443f599af41f97fc57cb7705b6d WatchSource:0}: Error finding container 5fb23b4ed9e37e028930743ab989b66444e1e443f599af41f97fc57cb7705b6d: Status 404 returned error can't find the container with id 5fb23b4ed9e37e028930743ab989b66444e1e443f599af41f97fc57cb7705b6d Apr 24 21:27:48.353060 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.352950 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:48.356224 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.356204 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf75630-71d7-404a-ad07-83f3fe8a8540-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-wxblx\" (UID: \"1cf75630-71d7-404a-ad07-83f3fe8a8540\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:48.577382 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.577357 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" Apr 24 21:27:48.728941 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.728910 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx"] Apr 24 21:27:48.733189 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:48.733163 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf75630_71d7_404a_ad07_83f3fe8a8540.slice/crio-5c3eaf167e99023c130d0d7708b935a70303590631f736b37625ea38571a80e6 WatchSource:0}: Error finding container 5c3eaf167e99023c130d0d7708b935a70303590631f736b37625ea38571a80e6: Status 404 returned error can't find the container with id 5c3eaf167e99023c130d0d7708b935a70303590631f736b37625ea38571a80e6 Apr 24 21:27:48.745064 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.745042 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:27:48.761548 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.761527 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.763089 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.763062 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764301 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764326 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764351 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764394 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764326 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 24 21:27:48.764536 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764533 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 24 21:27:48.764906 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764874 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 24 21:27:48.764961 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.764949 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 24 21:27:48.765090 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.765070 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 24 21:27:48.765200 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.765162 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kjc6d\"" Apr 24 21:27:48.857870 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.857838 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.857890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.857917 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.857982 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hhzv\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858111 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858177 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858244 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858559 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858296 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.858559 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.858327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.929660 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.929186 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbc8bc9f-jl2jn" event={"ID":"7e6f3edc-32c2-4a37-907c-b2d401989ea5","Type":"ContainerStarted","Data":"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b"} Apr 24 21:27:48.931853 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.931823 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96br4" event={"ID":"d8efd1be-eab8-42f7-8480-05613c349abf","Type":"ContainerStarted","Data":"0a241ed684aab3a718f15a8bc1996666ee7826c93d216617328fb1d8a7f0f4ea"} Apr 24 21:27:48.933448 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.933419 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" event={"ID":"1cf75630-71d7-404a-ad07-83f3fe8a8540","Type":"ContainerStarted","Data":"32e1e4f88ddbf629f024cd4285a55631b3146a66f73955cdf4a375296458c261"} Apr 24 21:27:48.933556 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.933459 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" event={"ID":"1cf75630-71d7-404a-ad07-83f3fe8a8540","Type":"ContainerStarted","Data":"5c3eaf167e99023c130d0d7708b935a70303590631f736b37625ea38571a80e6"} Apr 24 21:27:48.935270 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.935244 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" event={"ID":"3136303c-3def-4820-b28c-3092f1fb77db","Type":"ContainerStarted","Data":"5fb23b4ed9e37e028930743ab989b66444e1e443f599af41f97fc57cb7705b6d"} Apr 24 21:27:48.959671 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959642 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.959806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959700 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.959806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959728 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.959806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959765 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hhzv\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.959806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959797 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959818 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959878 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959899 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959925 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959943 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960053 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.959990 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960442 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.960085 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.960442 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.960122 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.963485 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.963205 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.963485 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.963304 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.963773 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.963717 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.967209 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.967167 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.970687 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.970662 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.971969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.971946 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.972383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.972357 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.972976 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.972815 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.973289 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.973245 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.973703 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.973679 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.980521 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.973804 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hhzv\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.980521 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.974113 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:48.980521 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:48.974165 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:49.074746 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.074552 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:27:49.229059 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.229006 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76cbc8bc9f-jl2jn" podStartSLOduration=2.5111002 podStartE2EDuration="6.228989471s" podCreationTimestamp="2026-04-24 21:27:43 +0000 UTC" firstStartedPulling="2026-04-24 21:27:44.243860827 +0000 UTC m=+48.098620499" lastFinishedPulling="2026-04-24 21:27:47.961750104 +0000 UTC m=+51.816509770" observedRunningTime="2026-04-24 21:27:48.95025821 +0000 UTC m=+52.805017901" watchObservedRunningTime="2026-04-24 21:27:49.228989471 +0000 UTC m=+53.083749167" Apr 24 21:27:49.230255 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.230227 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:27:49.343844 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:49.343811 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72468fa8_9625_4341_8007_a86820a9ca45.slice/crio-ab1d44a944519ba8be5ae4867f07b27cc3c60bf939857c24ad7ab3f0fd99c30a WatchSource:0}: Error finding container ab1d44a944519ba8be5ae4867f07b27cc3c60bf939857c24ad7ab3f0fd99c30a: Status 404 returned error can't find the container with id ab1d44a944519ba8be5ae4867f07b27cc3c60bf939857c24ad7ab3f0fd99c30a Apr 24 21:27:49.940404 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.939957 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96br4" event={"ID":"d8efd1be-eab8-42f7-8480-05613c349abf","Type":"ContainerStarted","Data":"3463db197b1af3391911b2082d15c6d7999e2cc176b3d6c23a956ef2970bfac4"} Apr 24 21:27:49.942279 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.942109 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" event={"ID":"1cf75630-71d7-404a-ad07-83f3fe8a8540","Type":"ContainerStarted","Data":"e8d4644a1de16046a105af3fc88418f775119a9bebf60ae7fcf46a90a609947e"} Apr 24 21:27:49.943329 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:49.943302 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"ab1d44a944519ba8be5ae4867f07b27cc3c60bf939857c24ad7ab3f0fd99c30a"} Apr 24 21:27:50.739424 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.739391 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dc5d49779-l4htf"] Apr 24 21:27:50.759139 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.757892 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dc5d49779-l4htf"] Apr 24 21:27:50.759139 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.758075 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.761539 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.761383 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 24 21:27:50.761539 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.761498 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 24 21:27:50.761539 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.761517 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s5mk2\"" Apr 24 21:27:50.761935 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.761916 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 24 21:27:50.762272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.762050 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-62mad5ua6cf9t\"" Apr 24 21:27:50.762272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.762153 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 24 21:27:50.762272 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.762208 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 24 21:27:50.776554 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776529 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776678 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776575 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776678 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776645 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhnhp\" (UniqueName: \"kubernetes.io/projected/450f1f68-e99a-4ee3-98cc-f522ec922f08-kube-api-access-bhnhp\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776792 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-grpc-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776792 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776772 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776883 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776804 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776883 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776850 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450f1f68-e99a-4ee3-98cc-f522ec922f08-metrics-client-ca\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.776949 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.776884 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877360 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877319 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877360 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877361 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877517 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnhp\" (UniqueName: \"kubernetes.io/projected/450f1f68-e99a-4ee3-98cc-f522ec922f08-kube-api-access-bhnhp\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877701 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877681 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-grpc-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877822 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877718 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877822 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877745 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877822 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877777 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450f1f68-e99a-4ee3-98cc-f522ec922f08-metrics-client-ca\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.877822 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.877807 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.881309 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.881146 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.881457 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.881164 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.881457 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.881449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-grpc-tls\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.881698 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.881682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.883529 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.883510 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.884887 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.884868 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/450f1f68-e99a-4ee3-98cc-f522ec922f08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.887202 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.887183 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhnhp\" (UniqueName: \"kubernetes.io/projected/450f1f68-e99a-4ee3-98cc-f522ec922f08-kube-api-access-bhnhp\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.890315 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.890291 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450f1f68-e99a-4ee3-98cc-f522ec922f08-metrics-client-ca\") pod \"thanos-querier-5dc5d49779-l4htf\" (UID: \"450f1f68-e99a-4ee3-98cc-f522ec922f08\") " pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:50.947903 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.947865 2571 generic.go:358] "Generic (PLEG): container finished" podID="d8efd1be-eab8-42f7-8480-05613c349abf" containerID="3463db197b1af3391911b2082d15c6d7999e2cc176b3d6c23a956ef2970bfac4" exitCode=0 Apr 24 21:27:50.948314 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.947945 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96br4" event={"ID":"d8efd1be-eab8-42f7-8480-05613c349abf","Type":"ContainerDied","Data":"3463db197b1af3391911b2082d15c6d7999e2cc176b3d6c23a956ef2970bfac4"} Apr 24 21:27:50.950059 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.950034 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" event={"ID":"3136303c-3def-4820-b28c-3092f1fb77db","Type":"ContainerStarted","Data":"7832c6671a96ceeed9bb3a01468c974f3c2a6db825d28790474a3db4017f6158"} Apr 24 21:27:50.950178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.950063 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" event={"ID":"3136303c-3def-4820-b28c-3092f1fb77db","Type":"ContainerStarted","Data":"c999ff2d12260ddf31cb9e38e81143de4299af91c01cbee9cf75aad860d3bea3"} Apr 24 21:27:50.950178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.950078 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" event={"ID":"3136303c-3def-4820-b28c-3092f1fb77db","Type":"ContainerStarted","Data":"f8c7cef6558e264b6a7052be76451a161228590ce736b5ff7f67f1541f05b4d8"} Apr 24 21:27:50.987741 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:50.987689 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-xdcwr" podStartSLOduration=2.180758253 podStartE2EDuration="3.987673424s" podCreationTimestamp="2026-04-24 21:27:47 +0000 UTC" firstStartedPulling="2026-04-24 21:27:48.134393795 +0000 UTC m=+51.989153476" lastFinishedPulling="2026-04-24 21:27:49.941308974 +0000 UTC m=+53.796068647" observedRunningTime="2026-04-24 21:27:50.987009763 +0000 UTC m=+54.841769479" watchObservedRunningTime="2026-04-24 21:27:50.987673424 +0000 UTC m=+54.842433148" Apr 24 21:27:51.069390 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.069324 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:51.485961 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.485934 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dc5d49779-l4htf"] Apr 24 21:27:51.568251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.568222 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:27:51.573803 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.573738 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.583771 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.583745 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 24 21:27:51.601608 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.601563 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:27:51.684503 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684476 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684503 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8fkj\" (UniqueName: \"kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684526 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684556 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684674 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684844 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684733 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.684844 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.684787 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785165 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785129 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785325 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785170 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fkj\" (UniqueName: \"kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785325 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785202 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785325 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785251 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785325 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785280 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785528 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785328 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785528 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785371 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785908 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785886 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.785994 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.785950 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.786029 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.786005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.786178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.786157 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.788365 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.788343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.788449 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.788376 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.793944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.793925 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fkj\" (UniqueName: \"kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj\") pod \"console-77bd5f67b7-mqmdg\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.911652 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.911575 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:27:51.956035 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.955994 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96br4" event={"ID":"d8efd1be-eab8-42f7-8480-05613c349abf","Type":"ContainerStarted","Data":"655b61a8df119cbeb26eec61d2e89359ba3db80ad4e5046f27f6c9d362e2c829"} Apr 24 21:27:51.956035 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.956039 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96br4" event={"ID":"d8efd1be-eab8-42f7-8480-05613c349abf","Type":"ContainerStarted","Data":"dee52e54091e630cdb94999d251896289a9f3e307877ae97b84c319c87032e00"} Apr 24 21:27:51.958538 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.958508 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" event={"ID":"1cf75630-71d7-404a-ad07-83f3fe8a8540","Type":"ContainerStarted","Data":"1e63e106bc6a0deaf59e48f6e7ff86b7cab936b4cba3b2fc1417b9d49a27cfa6"} Apr 24 21:27:51.961040 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.960329 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97" exitCode=0 Apr 24 21:27:51.961040 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.960397 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97"} Apr 24 21:27:51.962334 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.962298 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"e89e8a2115dc9eac8f92575559de4dc97056888aa7851a9efffbd98a983f77a5"} Apr 24 21:27:51.978931 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.978869 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-96br4" podStartSLOduration=3.299272955 podStartE2EDuration="4.978851377s" podCreationTimestamp="2026-04-24 21:27:47 +0000 UTC" firstStartedPulling="2026-04-24 21:27:48.033572755 +0000 UTC m=+51.888332421" lastFinishedPulling="2026-04-24 21:27:49.713151172 +0000 UTC m=+53.567910843" observedRunningTime="2026-04-24 21:27:51.978290992 +0000 UTC m=+55.833050718" watchObservedRunningTime="2026-04-24 21:27:51.978851377 +0000 UTC m=+55.833611069" Apr 24 21:27:51.996539 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:51.996495 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-wxblx" podStartSLOduration=2.802938608 podStartE2EDuration="4.996483021s" podCreationTimestamp="2026-04-24 21:27:47 +0000 UTC" firstStartedPulling="2026-04-24 21:27:49.157315276 +0000 UTC m=+53.012074958" lastFinishedPulling="2026-04-24 21:27:51.350859704 +0000 UTC m=+55.205619371" observedRunningTime="2026-04-24 21:27:51.994965988 +0000 UTC m=+55.849725689" watchObservedRunningTime="2026-04-24 21:27:51.996483021 +0000 UTC m=+55.851242739" Apr 24 21:27:52.035145 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.035114 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:27:52.038536 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:52.038510 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e9a49c_a7ca_499a_b390_f6eaefe0ee1f.slice/crio-b800e5200b6e9ad8131bc4c30dd76ea24410893bf0eac9feb734f3d998f15234 WatchSource:0}: Error finding container b800e5200b6e9ad8131bc4c30dd76ea24410893bf0eac9feb734f3d998f15234: Status 404 returned error can't find the container with id b800e5200b6e9ad8131bc4c30dd76ea24410893bf0eac9feb734f3d998f15234 Apr 24 21:27:52.182339 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.182268 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8684c4b6bf-hpz7c"] Apr 24 21:27:52.195865 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.195837 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8684c4b6bf-hpz7c"] Apr 24 21:27:52.196003 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.195962 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.199226 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.198811 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 24 21:27:52.199226 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.198811 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9l2zm\"" Apr 24 21:27:52.199226 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.198897 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 24 21:27:52.199226 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.199074 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 24 21:27:52.199226 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.199199 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 24 21:27:52.199571 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.199364 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9r8q3bqdk8160\"" Apr 24 21:27:52.290576 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290576 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290597 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-metrics-server-audit-profiles\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q59s9\" (UniqueName: \"kubernetes.io/projected/de203b20-8880-40d0-ad75-d535fd905491-kube-api-access-q59s9\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-client-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290806 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290752 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-client-certs\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290924 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290849 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-tls\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.290924 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.290890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de203b20-8880-40d0-ad75-d535fd905491-audit-log\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.391952 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392000 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-metrics-server-audit-profiles\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392041 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q59s9\" (UniqueName: \"kubernetes.io/projected/de203b20-8880-40d0-ad75-d535fd905491-kube-api-access-q59s9\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392087 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-client-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392105 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-client-certs\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392149 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-tls\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392174 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de203b20-8880-40d0-ad75-d535fd905491-audit-log\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.392578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de203b20-8880-40d0-ad75-d535fd905491-audit-log\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393350 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.393303 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.393909 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.393886 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de203b20-8880-40d0-ad75-d535fd905491-metrics-server-audit-profiles\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.395680 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.395655 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-client-ca-bundle\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.396215 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.396191 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-tls\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.396892 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.396869 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de203b20-8880-40d0-ad75-d535fd905491-secret-metrics-server-client-certs\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.401207 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.401185 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q59s9\" (UniqueName: \"kubernetes.io/projected/de203b20-8880-40d0-ad75-d535fd905491-kube-api-access-q59s9\") pod \"metrics-server-8684c4b6bf-hpz7c\" (UID: \"de203b20-8880-40d0-ad75-d535fd905491\") " pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.426924 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.426898 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w"] Apr 24 21:27:52.464699 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.464578 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w"] Apr 24 21:27:52.464802 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.464716 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:52.467437 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.467415 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 24 21:27:52.467578 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.467425 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-4fwds\"" Apr 24 21:27:52.493695 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.493639 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7491178b-c3f9-4208-809d-a2bb8ee65e1f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-45v8w\" (UID: \"7491178b-c3f9-4208-809d-a2bb8ee65e1f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:52.509482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.509457 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:27:52.594751 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.594639 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7491178b-c3f9-4208-809d-a2bb8ee65e1f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-45v8w\" (UID: \"7491178b-c3f9-4208-809d-a2bb8ee65e1f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:52.597517 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.597461 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7491178b-c3f9-4208-809d-a2bb8ee65e1f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-45v8w\" (UID: \"7491178b-c3f9-4208-809d-a2bb8ee65e1f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:52.659802 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.659716 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8684c4b6bf-hpz7c"] Apr 24 21:27:52.660629 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:52.660570 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde203b20_8880_40d0_ad75_d535fd905491.slice/crio-82bf320f0c48ccf2c33e89b07a0f594b76b32ac9b7b315994b9433535ea291a4 WatchSource:0}: Error finding container 82bf320f0c48ccf2c33e89b07a0f594b76b32ac9b7b315994b9433535ea291a4: Status 404 returned error can't find the container with id 82bf320f0c48ccf2c33e89b07a0f594b76b32ac9b7b315994b9433535ea291a4 Apr 24 21:27:52.776246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.776152 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:52.926520 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.926490 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w"] Apr 24 21:27:52.929597 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:52.929553 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7491178b_c3f9_4208_809d_a2bb8ee65e1f.slice/crio-d8c88d0555527e9e8bf69a79816ea59d77034e11403d27ff9eee1cde3c42e32d WatchSource:0}: Error finding container d8c88d0555527e9e8bf69a79816ea59d77034e11403d27ff9eee1cde3c42e32d: Status 404 returned error can't find the container with id d8c88d0555527e9e8bf69a79816ea59d77034e11403d27ff9eee1cde3c42e32d Apr 24 21:27:52.966516 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.966484 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" event={"ID":"de203b20-8880-40d0-ad75-d535fd905491","Type":"ContainerStarted","Data":"82bf320f0c48ccf2c33e89b07a0f594b76b32ac9b7b315994b9433535ea291a4"} Apr 24 21:27:52.967743 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.967709 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" event={"ID":"7491178b-c3f9-4208-809d-a2bb8ee65e1f","Type":"ContainerStarted","Data":"d8c88d0555527e9e8bf69a79816ea59d77034e11403d27ff9eee1cde3c42e32d"} Apr 24 21:27:52.971598 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.970965 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd5f67b7-mqmdg" event={"ID":"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f","Type":"ContainerStarted","Data":"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773"} Apr 24 21:27:52.971598 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.970996 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd5f67b7-mqmdg" event={"ID":"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f","Type":"ContainerStarted","Data":"b800e5200b6e9ad8131bc4c30dd76ea24410893bf0eac9feb734f3d998f15234"} Apr 24 21:27:52.997393 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:52.997341 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-77bd5f67b7-mqmdg" podStartSLOduration=1.997324839 podStartE2EDuration="1.997324839s" podCreationTimestamp="2026-04-24 21:27:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:27:52.997176046 +0000 UTC m=+56.851935734" watchObservedRunningTime="2026-04-24 21:27:52.997324839 +0000 UTC m=+56.852084522" Apr 24 21:27:53.913969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:53.913935 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qd6ql" Apr 24 21:27:54.097277 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.097242 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:54.097277 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.097288 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:54.102655 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.102630 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:54.109033 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.108994 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:27:54.133056 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.133029 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.135678 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.135652 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:27:54.136338 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.136318 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 24 21:27:54.136436 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.136424 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 24 21:27:54.136512 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.136492 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f5pv6\"" Apr 24 21:27:54.136772 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.136755 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 24 21:27:54.137260 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.137239 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 24 21:27:54.137367 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.137277 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 24 21:27:54.137773 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.137610 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 24 21:27:54.137869 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.137784 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 24 21:27:54.138330 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.138314 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 24 21:27:54.139657 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.139640 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 24 21:27:54.141853 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.141812 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 24 21:27:54.147494 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.147472 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3an8b0p3s7ri9\"" Apr 24 21:27:54.148134 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.148118 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 24 21:27:54.166218 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.166163 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 24 21:27:54.209952 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.209930 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210042 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.209962 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210042 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.209985 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210042 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210008 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl9fq\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210135 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210044 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210135 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210189 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210170 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210222 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210209 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210268 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210387 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210376 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210417 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210404 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210446 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210419 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210481 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210466 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210513 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210497 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210608 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210570 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210683 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210644 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210767 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.210821 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.210785 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.311529 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.311484 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312825 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312799 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312725 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312849 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312882 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312910 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312930 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.312968 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.312959 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313285 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313136 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313522 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313495 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313629 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313531 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313629 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313541 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313629 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313787 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313632 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313787 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313679 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313883 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313851 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313933 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313885 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.313933 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313909 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.314019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313933 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wl9fq\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.314019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.313964 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.314019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.314006 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.315568 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.315226 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.315726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.315707 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.316304 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.316261 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.317435 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.317405 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.318768 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.317849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.318768 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.318321 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.318768 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.318618 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.318768 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.318719 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.319036 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.319008 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.319420 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.319393 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.319853 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.319829 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.319936 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.319902 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.320149 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.320127 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.320266 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.320247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.326492 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.326467 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl9fq\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq\") pod \"prometheus-k8s-0\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.455726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.455697 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:27:54.658607 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.657956 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:27:54.662646 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:27:54.662615 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255c4b61_2bab_4d03_9871_8c819a38b3e5.slice/crio-239e45d21024a858afde35c12af247e9e0a7abae00887c0b1d903f3e933ce8cf WatchSource:0}: Error finding container 239e45d21024a858afde35c12af247e9e0a7abae00887c0b1d903f3e933ce8cf: Status 404 returned error can't find the container with id 239e45d21024a858afde35c12af247e9e0a7abae00887c0b1d903f3e933ce8cf Apr 24 21:27:54.991028 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.990991 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2"} Apr 24 21:27:54.991168 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.991038 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435"} Apr 24 21:27:54.991168 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.991058 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe"} Apr 24 21:27:54.995175 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.995147 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"7828b1f551b43205c488d87c40621a422e5ba85aadef82565376f34740c7a603"} Apr 24 21:27:54.995362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.995341 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"04c39c5e677836947a2d008d92a94a952a609071282d65f4effdaf6e1b793dd5"} Apr 24 21:27:54.995362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.995362 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"28c49ba69820310581df96d818a3268ddbb97902bd23f9da527ebd19c44df039"} Apr 24 21:27:54.997527 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.997468 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" exitCode=0 Apr 24 21:27:54.999510 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.999274 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} Apr 24 21:27:54.999510 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:54.999301 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"239e45d21024a858afde35c12af247e9e0a7abae00887c0b1d903f3e933ce8cf"} Apr 24 21:27:55.004347 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:55.004329 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:27:56.010903 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:56.010866 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc"} Apr 24 21:27:56.010903 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:56.010912 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d"} Apr 24 21:27:56.868688 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:56.868387 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc9kf" Apr 24 21:27:57.018197 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.018115 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerStarted","Data":"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf"} Apr 24 21:27:57.021543 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.021515 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"508d6c2d9cc63831fc0580a47441d543e984affa826b4732a9a73bea3a8b100e"} Apr 24 21:27:57.021737 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.021548 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"bd37e6de379aab2042e8a00abf2f70041b94dbae1ebc89bcafcfa091ec45bed9"} Apr 24 21:27:57.021737 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.021562 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" event={"ID":"450f1f68-e99a-4ee3-98cc-f522ec922f08","Type":"ContainerStarted","Data":"b34c1fc144f2c80f41c672461513aa7b70ca32737dcad25ab2152805df2578e9"} Apr 24 21:27:57.022086 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.022066 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:27:57.024274 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.024168 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" event={"ID":"de203b20-8880-40d0-ad75-d535fd905491","Type":"ContainerStarted","Data":"e6fa97d54ffab7b366009b76816eb93aff7187eb4e6959f064ddaabafba54dd2"} Apr 24 21:27:57.026135 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.025739 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" event={"ID":"7491178b-c3f9-4208-809d-a2bb8ee65e1f","Type":"ContainerStarted","Data":"38c75c38a6989f28ec1a6b2fe3720e80e245d4f53f7bce35ec5029cff9fb882d"} Apr 24 21:27:57.026135 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.026112 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:57.033015 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.032991 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" Apr 24 21:27:57.085954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.082721 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.724712506 podStartE2EDuration="9.082701349s" podCreationTimestamp="2026-04-24 21:27:48 +0000 UTC" firstStartedPulling="2026-04-24 21:27:49.360903112 +0000 UTC m=+53.215662790" lastFinishedPulling="2026-04-24 21:27:56.718891946 +0000 UTC m=+60.573651633" observedRunningTime="2026-04-24 21:27:57.057463008 +0000 UTC m=+60.912222698" watchObservedRunningTime="2026-04-24 21:27:57.082701349 +0000 UTC m=+60.937461040" Apr 24 21:27:57.118924 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.118862 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-45v8w" podStartSLOduration=1.457860715 podStartE2EDuration="5.118843688s" podCreationTimestamp="2026-04-24 21:27:52 +0000 UTC" firstStartedPulling="2026-04-24 21:27:52.931874645 +0000 UTC m=+56.786634315" lastFinishedPulling="2026-04-24 21:27:56.592857607 +0000 UTC m=+60.447617288" observedRunningTime="2026-04-24 21:27:57.083316638 +0000 UTC m=+60.938076328" watchObservedRunningTime="2026-04-24 21:27:57.118843688 +0000 UTC m=+60.973603359" Apr 24 21:27:57.119617 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.119567 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" podStartSLOduration=1.960019932 podStartE2EDuration="7.119557114s" podCreationTimestamp="2026-04-24 21:27:50 +0000 UTC" firstStartedPulling="2026-04-24 21:27:51.494714905 +0000 UTC m=+55.349474572" lastFinishedPulling="2026-04-24 21:27:56.654252076 +0000 UTC m=+60.509011754" observedRunningTime="2026-04-24 21:27:57.116088009 +0000 UTC m=+60.970847701" watchObservedRunningTime="2026-04-24 21:27:57.119557114 +0000 UTC m=+60.974316810" Apr 24 21:27:57.149909 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.149766 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" podStartSLOduration=1.2193973630000001 podStartE2EDuration="5.149746484s" podCreationTimestamp="2026-04-24 21:27:52 +0000 UTC" firstStartedPulling="2026-04-24 21:27:52.662660826 +0000 UTC m=+56.517420496" lastFinishedPulling="2026-04-24 21:27:56.593009947 +0000 UTC m=+60.447769617" observedRunningTime="2026-04-24 21:27:57.145051278 +0000 UTC m=+60.999810967" watchObservedRunningTime="2026-04-24 21:27:57.149746484 +0000 UTC m=+61.004506167" Apr 24 21:27:57.391429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:57.391347 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:27:59.036320 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036280 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} Apr 24 21:27:59.036721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036327 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} Apr 24 21:27:59.036721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036342 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} Apr 24 21:27:59.036721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036355 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} Apr 24 21:27:59.036721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036363 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} Apr 24 21:27:59.036721 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.036371 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerStarted","Data":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} Apr 24 21:27:59.069165 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.069106 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.778375682 podStartE2EDuration="5.069091977s" podCreationTimestamp="2026-04-24 21:27:54 +0000 UTC" firstStartedPulling="2026-04-24 21:27:55.000350829 +0000 UTC m=+58.855110515" lastFinishedPulling="2026-04-24 21:27:58.291067141 +0000 UTC m=+62.145826810" observedRunningTime="2026-04-24 21:27:59.068031915 +0000 UTC m=+62.922791605" watchObservedRunningTime="2026-04-24 21:27:59.069091977 +0000 UTC m=+62.923851738" Apr 24 21:27:59.455838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:27:59.455807 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:01.912724 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:01.912681 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:28:02.394873 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.394819 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:28:02.398457 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.398439 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 21:28:02.408019 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.407999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7151d443-18e1-458e-a1d5-d2536594c786-metrics-certs\") pod \"network-metrics-daemon-4h277\" (UID: \"7151d443-18e1-458e-a1d5-d2536594c786\") " pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:28:02.496266 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.496210 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:28:02.498862 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.498838 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 21:28:02.498966 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.498903 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vd7zr\"" Apr 24 21:28:02.507101 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.507081 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h277" Apr 24 21:28:02.511241 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.511213 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 21:28:02.520373 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.520346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqm6\" (UniqueName: \"kubernetes.io/projected/8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9-kube-api-access-rbqm6\") pod \"network-check-target-ztccj\" (UID: \"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9\") " pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:28:02.629614 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.629560 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4h277"] Apr 24 21:28:02.632212 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:28:02.632184 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7151d443_18e1_458e_a1d5_d2536594c786.slice/crio-45306e27dc98678cce8b3ce25d5d0ac9bf84be38316ac35990abdcac151c81b5 WatchSource:0}: Error finding container 45306e27dc98678cce8b3ce25d5d0ac9bf84be38316ac35990abdcac151c81b5: Status 404 returned error can't find the container with id 45306e27dc98678cce8b3ce25d5d0ac9bf84be38316ac35990abdcac151c81b5 Apr 24 21:28:02.804315 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.804281 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9lwz\"" Apr 24 21:28:02.812446 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.812416 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:28:02.943222 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:02.943037 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztccj"] Apr 24 21:28:02.945760 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:28:02.945726 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8065db05_6bcb_4dbf_8e1b_d1709c4ca5e9.slice/crio-649f923436096989ba847a8aa75a5665cdad40b932c8211959ca910d4c514aee WatchSource:0}: Error finding container 649f923436096989ba847a8aa75a5665cdad40b932c8211959ca910d4c514aee: Status 404 returned error can't find the container with id 649f923436096989ba847a8aa75a5665cdad40b932c8211959ca910d4c514aee Apr 24 21:28:03.036381 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:03.036355 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dc5d49779-l4htf" Apr 24 21:28:03.049508 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:03.049477 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztccj" event={"ID":"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9","Type":"ContainerStarted","Data":"649f923436096989ba847a8aa75a5665cdad40b932c8211959ca910d4c514aee"} Apr 24 21:28:03.050505 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:03.050487 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h277" event={"ID":"7151d443-18e1-458e-a1d5-d2536594c786","Type":"ContainerStarted","Data":"45306e27dc98678cce8b3ce25d5d0ac9bf84be38316ac35990abdcac151c81b5"} Apr 24 21:28:04.057255 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:04.057176 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h277" event={"ID":"7151d443-18e1-458e-a1d5-d2536594c786","Type":"ContainerStarted","Data":"8f6cfd2d6dfe02d852bce1cf846a7893e80ee20c25b4d796fb19e6f6f751f55e"} Apr 24 21:28:04.057255 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:04.057221 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h277" event={"ID":"7151d443-18e1-458e-a1d5-d2536594c786","Type":"ContainerStarted","Data":"727be23d2d4585f1f0666f790d792a2c21afa5e1a0fe778d58a27d2b80eb5a28"} Apr 24 21:28:04.081981 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:04.081920 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4h277" podStartSLOduration=66.976012381 podStartE2EDuration="1m8.081900079s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:28:02.634150616 +0000 UTC m=+66.488910283" lastFinishedPulling="2026-04-24 21:28:03.740038301 +0000 UTC m=+67.594797981" observedRunningTime="2026-04-24 21:28:04.080092483 +0000 UTC m=+67.934852172" watchObservedRunningTime="2026-04-24 21:28:04.081900079 +0000 UTC m=+67.936659769" Apr 24 21:28:05.876822 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:05.876793 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:05.895777 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:05.895753 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:06.066021 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:06.065927 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztccj" event={"ID":"8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9","Type":"ContainerStarted","Data":"2c7ddf245b287c8490816bc376dfdc048ba2ac1d0a0ca5e7fb03f84653cf4087"} Apr 24 21:28:06.066427 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:06.066403 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:28:06.081896 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:06.081876 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:06.086195 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:06.086157 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztccj" podStartSLOduration=67.220256022 podStartE2EDuration="1m10.086143408s" podCreationTimestamp="2026-04-24 21:26:56 +0000 UTC" firstStartedPulling="2026-04-24 21:28:02.947629928 +0000 UTC m=+66.802389595" lastFinishedPulling="2026-04-24 21:28:05.813517311 +0000 UTC m=+69.668276981" observedRunningTime="2026-04-24 21:28:06.084835421 +0000 UTC m=+69.939595110" watchObservedRunningTime="2026-04-24 21:28:06.086143408 +0000 UTC m=+69.940903098" Apr 24 21:28:07.888675 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:07.888558 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:28:12.510285 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:12.510249 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:28:12.510285 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:12.510296 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:28:22.412946 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.412885 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-77bd5f67b7-mqmdg" podUID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" containerName="console" containerID="cri-o://915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773" gracePeriod=15 Apr 24 21:28:22.651957 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.651936 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77bd5f67b7-mqmdg_16e9a49c-a7ca-499a-b390-f6eaefe0ee1f/console/0.log" Apr 24 21:28:22.652063 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.652010 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:28:22.670566 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670505 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670566 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670539 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670753 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670609 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8fkj\" (UniqueName: \"kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670753 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670635 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670753 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670666 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670753 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670705 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.670753 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.670746 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert\") pod \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\" (UID: \"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f\") " Apr 24 21:28:22.671050 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.671000 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:22.671050 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.671004 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config" (OuterVolumeSpecName: "console-config") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:22.671281 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.671264 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:22.671281 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.671260 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:22.672981 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.672954 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:22.673065 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.673038 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj" (OuterVolumeSpecName: "kube-api-access-z8fkj") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "kube-api-access-z8fkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:22.673175 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.673156 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" (UID: "16e9a49c-a7ca-499a-b390-f6eaefe0ee1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:22.771880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771856 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-serving-cert\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.771880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771877 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-service-ca\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.771880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771888 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8fkj\" (UniqueName: \"kubernetes.io/projected/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-kube-api-access-z8fkj\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.772146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771898 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.772146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771907 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-console-oauth-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.772146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771916 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-trusted-ca-bundle\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:22.772146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:22.771924 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f-oauth-serving-cert\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:23.122111 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122085 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77bd5f67b7-mqmdg_16e9a49c-a7ca-499a-b390-f6eaefe0ee1f/console/0.log" Apr 24 21:28:23.122290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122123 2571 generic.go:358] "Generic (PLEG): container finished" podID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" containerID="915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773" exitCode=2 Apr 24 21:28:23.122290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122195 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd5f67b7-mqmdg" Apr 24 21:28:23.122290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122208 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd5f67b7-mqmdg" event={"ID":"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f","Type":"ContainerDied","Data":"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773"} Apr 24 21:28:23.122290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122246 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd5f67b7-mqmdg" event={"ID":"16e9a49c-a7ca-499a-b390-f6eaefe0ee1f","Type":"ContainerDied","Data":"b800e5200b6e9ad8131bc4c30dd76ea24410893bf0eac9feb734f3d998f15234"} Apr 24 21:28:23.122290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.122262 2571 scope.go:117] "RemoveContainer" containerID="915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773" Apr 24 21:28:23.130442 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.130422 2571 scope.go:117] "RemoveContainer" containerID="915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773" Apr 24 21:28:23.130717 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:23.130695 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773\": container with ID starting with 915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773 not found: ID does not exist" containerID="915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773" Apr 24 21:28:23.130775 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.130726 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773"} err="failed to get container status \"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773\": rpc error: code = NotFound desc = could not find container \"915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773\": container with ID starting with 915a8b8061977766f0f4902a204c6f0d493017df9ef9d9357ad66c0f30999773 not found: ID does not exist" Apr 24 21:28:23.142715 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.142693 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:28:23.148148 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:23.148113 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77bd5f67b7-mqmdg"] Apr 24 21:28:24.694008 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:24.693975 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" path="/var/lib/kubelet/pods/16e9a49c-a7ca-499a-b390-f6eaefe0ee1f/volumes" Apr 24 21:28:32.515562 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:32.515529 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:28:32.519477 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:32.519451 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8684c4b6bf-hpz7c" Apr 24 21:28:32.907961 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:32.907858 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76cbc8bc9f-jl2jn" podUID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" containerName="console" containerID="cri-o://00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b" gracePeriod=15 Apr 24 21:28:33.146799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.146776 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76cbc8bc9f-jl2jn_7e6f3edc-32c2-4a37-907c-b2d401989ea5/console/0.log" Apr 24 21:28:33.146906 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.146841 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:28:33.154131 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154111 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76cbc8bc9f-jl2jn_7e6f3edc-32c2-4a37-907c-b2d401989ea5/console/0.log" Apr 24 21:28:33.154230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154149 2571 generic.go:358] "Generic (PLEG): container finished" podID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" containerID="00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b" exitCode=2 Apr 24 21:28:33.154230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154186 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbc8bc9f-jl2jn" event={"ID":"7e6f3edc-32c2-4a37-907c-b2d401989ea5","Type":"ContainerDied","Data":"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b"} Apr 24 21:28:33.154230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154203 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbc8bc9f-jl2jn" Apr 24 21:28:33.154230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154227 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbc8bc9f-jl2jn" event={"ID":"7e6f3edc-32c2-4a37-907c-b2d401989ea5","Type":"ContainerDied","Data":"e1e394a4d80d96163c1c08b85f41e4a36572ac7505af1019c29189cfd132165a"} Apr 24 21:28:33.154425 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.154244 2571 scope.go:117] "RemoveContainer" containerID="00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b" Apr 24 21:28:33.162057 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.162040 2571 scope.go:117] "RemoveContainer" containerID="00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b" Apr 24 21:28:33.162309 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:33.162280 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b\": container with ID starting with 00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b not found: ID does not exist" containerID="00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b" Apr 24 21:28:33.162400 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.162306 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b"} err="failed to get container status \"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b\": rpc error: code = NotFound desc = could not find container \"00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b\": container with ID starting with 00c1511748dce4132da3118d4edb63498de55d894ce30d9d62f002d06e54943b not found: ID does not exist" Apr 24 21:28:33.254030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.253999 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpdlg\" (UniqueName: \"kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254030 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254037 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254247 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254073 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254247 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254195 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254354 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254288 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254354 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254328 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config\") pod \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\" (UID: \"7e6f3edc-32c2-4a37-907c-b2d401989ea5\") " Apr 24 21:28:33.254480 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254453 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:33.254553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254513 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config" (OuterVolumeSpecName: "console-config") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:33.254999 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254620 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:33.254999 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254859 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-oauth-serving-cert\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.254999 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254938 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-service-ca\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.254999 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.254953 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.256441 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.256412 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:33.256441 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.256420 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg" (OuterVolumeSpecName: "kube-api-access-rpdlg") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "kube-api-access-rpdlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:33.256955 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.256940 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e6f3edc-32c2-4a37-907c-b2d401989ea5" (UID: "7e6f3edc-32c2-4a37-907c-b2d401989ea5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:33.355934 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.355902 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-serving-cert\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.355934 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.355934 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e6f3edc-32c2-4a37-907c-b2d401989ea5-console-oauth-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.356124 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.355947 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpdlg\" (UniqueName: \"kubernetes.io/projected/7e6f3edc-32c2-4a37-907c-b2d401989ea5-kube-api-access-rpdlg\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:33.500959 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.500932 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:28:33.509004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:33.508973 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76cbc8bc9f-jl2jn"] Apr 24 21:28:34.691961 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:34.691928 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" path="/var/lib/kubelet/pods/7e6f3edc-32c2-4a37-907c-b2d401989ea5/volumes" Apr 24 21:28:37.619192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619150 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:37.619684 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619632 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="alertmanager" containerID="cri-o://c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" gracePeriod=120 Apr 24 21:28:37.619684 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619637 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-web" containerID="cri-o://2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" gracePeriod=120 Apr 24 21:28:37.619895 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619660 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-metric" containerID="cri-o://ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" gracePeriod=120 Apr 24 21:28:37.619895 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619689 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy" containerID="cri-o://1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" gracePeriod=120 Apr 24 21:28:37.619895 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619704 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="prom-label-proxy" containerID="cri-o://09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" gracePeriod=120 Apr 24 21:28:37.619895 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:37.619662 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="config-reloader" containerID="cri-o://f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" gracePeriod=120 Apr 24 21:28:38.080284 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.080257 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztccj" Apr 24 21:28:38.175748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175717 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" exitCode=0 Apr 24 21:28:38.175748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175742 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" exitCode=0 Apr 24 21:28:38.175748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175748 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" exitCode=0 Apr 24 21:28:38.175748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175756 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" exitCode=0 Apr 24 21:28:38.176000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175791 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf"} Apr 24 21:28:38.176000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175824 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d"} Apr 24 21:28:38.176000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175834 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435"} Apr 24 21:28:38.176000 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.175844 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe"} Apr 24 21:28:38.866996 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.866976 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:38.903924 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.903894 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.903939 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.903966 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.903983 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904003 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904026 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904070 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904045 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904078 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904440 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904398 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 21:28:38.904552 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904530 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904631 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904606 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.904694 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904645 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hhzv\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904719 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904885 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config\") pod \"72468fa8-9625-4341-8007-a86820a9ca45\" (UID: \"72468fa8-9625-4341-8007-a86820a9ca45\") " Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.904929 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.905158 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-main-db\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.905178 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:38.905799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.905578 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:38.907852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.907808 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.908301 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.908195 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.908390 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.908275 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv" (OuterVolumeSpecName: "kube-api-access-6hhzv") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "kube-api-access-6hhzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:38.909428 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.909038 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out" (OuterVolumeSpecName: "config-out") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 21:28:38.909428 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.909235 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:38.910360 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.910000 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.911025 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.910947 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume" (OuterVolumeSpecName: "config-volume") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.911184 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.911064 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.915805 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.915491 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:38.922948 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:38.922917 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config" (OuterVolumeSpecName: "web-config") pod "72468fa8-9625-4341-8007-a86820a9ca45" (UID: "72468fa8-9625-4341-8007-a86820a9ca45"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006298 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72468fa8-9625-4341-8007-a86820a9ca45-metrics-client-ca\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006329 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hhzv\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-kube-api-access-6hhzv\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006340 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006351 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-web-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006364 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-main-tls\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006374 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006383 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006383 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72468fa8-9625-4341-8007-a86820a9ca45-config-out\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006392 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006400 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-cluster-tls-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006410 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72468fa8-9625-4341-8007-a86820a9ca45-tls-assets\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.006726 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.006419 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72468fa8-9625-4341-8007-a86820a9ca45-config-volume\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:39.180782 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180742 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" exitCode=0 Apr 24 21:28:39.180782 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180776 2571 generic.go:358] "Generic (PLEG): container finished" podID="72468fa8-9625-4341-8007-a86820a9ca45" containerID="2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" exitCode=0 Apr 24 21:28:39.180988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180830 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc"} Apr 24 21:28:39.180988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180849 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.180988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180873 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2"} Apr 24 21:28:39.180988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180884 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72468fa8-9625-4341-8007-a86820a9ca45","Type":"ContainerDied","Data":"ab1d44a944519ba8be5ae4867f07b27cc3c60bf939857c24ad7ab3f0fd99c30a"} Apr 24 21:28:39.180988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.180899 2571 scope.go:117] "RemoveContainer" containerID="09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" Apr 24 21:28:39.188447 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.188425 2571 scope.go:117] "RemoveContainer" containerID="ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" Apr 24 21:28:39.195294 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.195276 2571 scope.go:117] "RemoveContainer" containerID="1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" Apr 24 21:28:39.201770 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.201755 2571 scope.go:117] "RemoveContainer" containerID="2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" Apr 24 21:28:39.205951 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.205928 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:39.209348 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.209318 2571 scope.go:117] "RemoveContainer" containerID="f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" Apr 24 21:28:39.210537 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.210514 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:39.215775 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.215759 2571 scope.go:117] "RemoveContainer" containerID="c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" Apr 24 21:28:39.222312 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.222287 2571 scope.go:117] "RemoveContainer" containerID="3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97" Apr 24 21:28:39.228802 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.228784 2571 scope.go:117] "RemoveContainer" containerID="09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" Apr 24 21:28:39.229052 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.229036 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf\": container with ID starting with 09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf not found: ID does not exist" containerID="09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" Apr 24 21:28:39.229095 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229059 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf"} err="failed to get container status \"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf\": rpc error: code = NotFound desc = could not find container \"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf\": container with ID starting with 09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf not found: ID does not exist" Apr 24 21:28:39.229095 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229076 2571 scope.go:117] "RemoveContainer" containerID="ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" Apr 24 21:28:39.229289 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.229272 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc\": container with ID starting with ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc not found: ID does not exist" containerID="ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" Apr 24 21:28:39.229330 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229295 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc"} err="failed to get container status \"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc\": rpc error: code = NotFound desc = could not find container \"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc\": container with ID starting with ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc not found: ID does not exist" Apr 24 21:28:39.229330 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229312 2571 scope.go:117] "RemoveContainer" containerID="1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" Apr 24 21:28:39.229539 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.229523 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d\": container with ID starting with 1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d not found: ID does not exist" containerID="1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" Apr 24 21:28:39.229632 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229551 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d"} err="failed to get container status \"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d\": rpc error: code = NotFound desc = could not find container \"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d\": container with ID starting with 1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d not found: ID does not exist" Apr 24 21:28:39.229632 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229565 2571 scope.go:117] "RemoveContainer" containerID="2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" Apr 24 21:28:39.229799 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.229771 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2\": container with ID starting with 2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2 not found: ID does not exist" containerID="2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" Apr 24 21:28:39.229841 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229803 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2"} err="failed to get container status \"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2\": rpc error: code = NotFound desc = could not find container \"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2\": container with ID starting with 2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2 not found: ID does not exist" Apr 24 21:28:39.229841 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.229819 2571 scope.go:117] "RemoveContainer" containerID="f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" Apr 24 21:28:39.230053 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.230039 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435\": container with ID starting with f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435 not found: ID does not exist" containerID="f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" Apr 24 21:28:39.230096 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230057 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435"} err="failed to get container status \"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435\": rpc error: code = NotFound desc = could not find container \"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435\": container with ID starting with f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435 not found: ID does not exist" Apr 24 21:28:39.230096 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230075 2571 scope.go:117] "RemoveContainer" containerID="c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" Apr 24 21:28:39.230304 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.230287 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe\": container with ID starting with c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe not found: ID does not exist" containerID="c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" Apr 24 21:28:39.230343 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230309 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe"} err="failed to get container status \"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe\": rpc error: code = NotFound desc = could not find container \"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe\": container with ID starting with c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe not found: ID does not exist" Apr 24 21:28:39.230343 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230325 2571 scope.go:117] "RemoveContainer" containerID="3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97" Apr 24 21:28:39.230516 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:39.230500 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97\": container with ID starting with 3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97 not found: ID does not exist" containerID="3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97" Apr 24 21:28:39.230563 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230520 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97"} err="failed to get container status \"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97\": rpc error: code = NotFound desc = could not find container \"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97\": container with ID starting with 3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97 not found: ID does not exist" Apr 24 21:28:39.230563 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230534 2571 scope.go:117] "RemoveContainer" containerID="09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf" Apr 24 21:28:39.230758 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230737 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf"} err="failed to get container status \"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf\": rpc error: code = NotFound desc = could not find container \"09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf\": container with ID starting with 09588bd57e0c2cb247f9762193f90ec1433bc9891428612aecc438c635667eaf not found: ID does not exist" Apr 24 21:28:39.230798 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230761 2571 scope.go:117] "RemoveContainer" containerID="ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc" Apr 24 21:28:39.230960 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230934 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc"} err="failed to get container status \"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc\": rpc error: code = NotFound desc = could not find container \"ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc\": container with ID starting with ce7783ae0d436d7815a057b585c47d48b832162024980cb6ea84a4bc8e105bcc not found: ID does not exist" Apr 24 21:28:39.231034 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.230962 2571 scope.go:117] "RemoveContainer" containerID="1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d" Apr 24 21:28:39.231189 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231170 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d"} err="failed to get container status \"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d\": rpc error: code = NotFound desc = could not find container \"1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d\": container with ID starting with 1f2819a079d5daae4d8f196461813827cb7897a6ce9e9bb00def542e0b65185d not found: ID does not exist" Apr 24 21:28:39.231232 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231189 2571 scope.go:117] "RemoveContainer" containerID="2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2" Apr 24 21:28:39.231390 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231376 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2"} err="failed to get container status \"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2\": rpc error: code = NotFound desc = could not find container \"2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2\": container with ID starting with 2b75f2566e90ee64cffad8ff10b562ce25c0031a17c3c5c2e3428497723db1d2 not found: ID does not exist" Apr 24 21:28:39.231390 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231389 2571 scope.go:117] "RemoveContainer" containerID="f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435" Apr 24 21:28:39.231621 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231578 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435"} err="failed to get container status \"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435\": rpc error: code = NotFound desc = could not find container \"f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435\": container with ID starting with f5ad1428331becef68778471f05425e7bae7bd6b55b352931862a24c8deca435 not found: ID does not exist" Apr 24 21:28:39.231696 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231624 2571 scope.go:117] "RemoveContainer" containerID="c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe" Apr 24 21:28:39.231820 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231806 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe"} err="failed to get container status \"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe\": rpc error: code = NotFound desc = could not find container \"c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe\": container with ID starting with c04588bfd228f31fe95ded40819b461a03a1cd9b2b147a092312c176a9afadbe not found: ID does not exist" Apr 24 21:28:39.231870 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231821 2571 scope.go:117] "RemoveContainer" containerID="3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97" Apr 24 21:28:39.231982 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.231966 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97"} err="failed to get container status \"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97\": rpc error: code = NotFound desc = could not find container \"3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97\": container with ID starting with 3934501e4fc0fcc0970364c988b3f82426adbc942a723a2c09d3c0192f207f97 not found: ID does not exist" Apr 24 21:28:39.239273 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.239251 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:39.240059 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240038 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="alertmanager" Apr 24 21:28:39.240151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240061 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="alertmanager" Apr 24 21:28:39.240151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240096 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="init-config-reloader" Apr 24 21:28:39.240151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240106 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="init-config-reloader" Apr 24 21:28:39.240151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240127 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" containerName="console" Apr 24 21:28:39.240151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240136 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" containerName="console" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240157 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="config-reloader" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240166 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="config-reloader" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240187 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240196 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240208 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="prom-label-proxy" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240217 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="prom-label-proxy" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240238 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-web" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240247 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-web" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240279 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-metric" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240288 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-metric" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240309 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" containerName="console" Apr 24 21:28:39.240380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240318 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" containerName="console" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240456 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-metric" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240478 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="prom-label-proxy" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240498 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e6f3edc-32c2-4a37-907c-b2d401989ea5" containerName="console" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240508 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="16e9a49c-a7ca-499a-b390-f6eaefe0ee1f" containerName="console" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240519 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240530 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="config-reloader" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240547 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="kube-rbac-proxy-web" Apr 24 21:28:39.242429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.240557 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="72468fa8-9625-4341-8007-a86820a9ca45" containerName="alertmanager" Apr 24 21:28:39.247359 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.247339 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.250413 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.250393 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 24 21:28:39.250496 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.250460 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 24 21:28:39.251002 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.250985 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 24 21:28:39.251002 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.250996 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 24 21:28:39.251255 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.251240 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kjc6d\"" Apr 24 21:28:39.251304 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.251239 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 24 21:28:39.251304 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.251286 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 24 21:28:39.251304 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.251298 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 24 21:28:39.251839 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.251825 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 24 21:28:39.260500 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.260450 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 24 21:28:39.260852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.260834 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:39.309269 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309237 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309269 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309268 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309292 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-web-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309316 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309343 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309369 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-out\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309403 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309433 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309500 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309606 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.309774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.309688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fn4k\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-kube-api-access-2fn4k\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410241 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410192 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-web-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410241 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410252 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410489 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410270 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410489 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410295 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-out\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410489 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410461 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410685 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410509 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410685 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410560 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410685 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410618 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410685 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410653 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410686 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410721 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fn4k\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-kube-api-access-2fn4k\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410767 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410796 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.410880 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.410849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.411281 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.411179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.412160 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.412133 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413321 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413296 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-out\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413743 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413712 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-web-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413743 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413731 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413941 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413809 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413997 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413949 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.413997 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.413966 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.414065 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.414057 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.414755 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.414733 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.415612 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.415579 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.422453 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.422432 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fn4k\" (UniqueName: \"kubernetes.io/projected/e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84-kube-api-access-2fn4k\") pod \"alertmanager-main-0\" (UID: \"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.557021 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.556931 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:28:39.683345 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:39.683320 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:28:39.685036 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:28:39.685013 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ec4f85_0cf9_4e1e_bb59_a97f6fcabf84.slice/crio-e3c07db7fd2008031a079bae75e953b730e479096673953b4e8ad36118540e04 WatchSource:0}: Error finding container e3c07db7fd2008031a079bae75e953b730e479096673953b4e8ad36118540e04: Status 404 returned error can't find the container with id e3c07db7fd2008031a079bae75e953b730e479096673953b4e8ad36118540e04 Apr 24 21:28:40.186111 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:40.186075 2571 generic.go:358] "Generic (PLEG): container finished" podID="e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84" containerID="6276b7dba47eca4f0749daf83d3cf5bbe00fa660089f4c5199f8e65e5efd0d77" exitCode=0 Apr 24 21:28:40.186111 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:40.186116 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerDied","Data":"6276b7dba47eca4f0749daf83d3cf5bbe00fa660089f4c5199f8e65e5efd0d77"} Apr 24 21:28:40.186513 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:40.186141 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"e3c07db7fd2008031a079bae75e953b730e479096673953b4e8ad36118540e04"} Apr 24 21:28:40.691427 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:40.691396 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72468fa8-9625-4341-8007-a86820a9ca45" path="/var/lib/kubelet/pods/72468fa8-9625-4341-8007-a86820a9ca45/volumes" Apr 24 21:28:41.192007 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.191975 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"902a3aa3db8ef67ed6adf6978b72ce235b282ed8d12a930eee6c8af870064acf"} Apr 24 21:28:41.192007 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.192008 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"762c99ec07d2b8c46377592a4902c1330d4fd26d37eea0ef1a67b44c4a5900d3"} Apr 24 21:28:41.192395 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.192017 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"22e308f1858827b1b2c253f36fc7496909e505b4abb62467b3466ded90047a43"} Apr 24 21:28:41.192395 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.192025 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"261dfbca1769d185b1edfba32b60a23aab130ae874aa6f9a711ef69880cfd7fb"} Apr 24 21:28:41.192395 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.192033 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"a50f9928652b321e55f9915f6bc99150708632e97a9368c1421294faaa1b3e9f"} Apr 24 21:28:41.192395 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.192042 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84","Type":"ContainerStarted","Data":"ce3a9bddddfb38eff016538b8a10c0a24c1b3194adcebbb82cc4e9bea95ba253"} Apr 24 21:28:41.234556 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.234508 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.234493255 podStartE2EDuration="2.234493255s" podCreationTimestamp="2026-04-24 21:28:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:28:41.231355882 +0000 UTC m=+105.086115582" watchObservedRunningTime="2026-04-24 21:28:41.234493255 +0000 UTC m=+105.089252991" Apr 24 21:28:41.562678 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.562596 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-cf78b7565-frqnn"] Apr 24 21:28:41.566204 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.566187 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.570119 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.570093 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 24 21:28:41.570416 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.570396 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 24 21:28:41.570501 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.570420 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 24 21:28:41.571235 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.571216 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-97nkj\"" Apr 24 21:28:41.572773 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.572749 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 24 21:28:41.575110 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.575087 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 24 21:28:41.577869 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.577850 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 24 21:28:41.587374 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.587350 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cf78b7565-frqnn"] Apr 24 21:28:41.629945 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.629914 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf984\" (UniqueName: \"kubernetes.io/projected/5a194a78-5ba5-45d9-a118-d63acc7a75a2-kube-api-access-cf984\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.629945 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.629949 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630144 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.629969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-metrics-client-ca\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630144 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.630065 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-serving-certs-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630144 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.630118 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630237 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.630143 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630237 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.630167 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-federate-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.630237 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.630200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731227 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731190 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731227 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731226 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731459 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731250 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-federate-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731459 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731278 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731459 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731315 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf984\" (UniqueName: \"kubernetes.io/projected/5a194a78-5ba5-45d9-a118-d63acc7a75a2-kube-api-access-cf984\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731570 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731454 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731570 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731502 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-metrics-client-ca\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.731699 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.731571 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-serving-certs-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.732294 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.732269 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-serving-certs-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.732410 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.732269 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.732567 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.732537 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a194a78-5ba5-45d9-a118-d63acc7a75a2-metrics-client-ca\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.734269 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.734223 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-federate-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.734935 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.734912 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-telemeter-client-tls\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.735354 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.735327 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.735797 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.735778 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a194a78-5ba5-45d9-a118-d63acc7a75a2-secret-telemeter-client\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.744385 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.744361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf984\" (UniqueName: \"kubernetes.io/projected/5a194a78-5ba5-45d9-a118-d63acc7a75a2-kube-api-access-cf984\") pod \"telemeter-client-cf78b7565-frqnn\" (UID: \"5a194a78-5ba5-45d9-a118-d63acc7a75a2\") " pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:41.864555 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.864465 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:41.865206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865085 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="prometheus" containerID="cri-o://5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" gracePeriod=600 Apr 24 21:28:41.865206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865104 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" gracePeriod=600 Apr 24 21:28:41.865206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865101 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-web" containerID="cri-o://12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" gracePeriod=600 Apr 24 21:28:41.865206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865147 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="config-reloader" containerID="cri-o://0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" gracePeriod=600 Apr 24 21:28:41.865206 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865168 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy" containerID="cri-o://965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" gracePeriod=600 Apr 24 21:28:41.865515 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.865335 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="thanos-sidecar" containerID="cri-o://5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" gracePeriod=600 Apr 24 21:28:41.877072 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:41.877047 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" Apr 24 21:28:42.025319 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.025282 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cf78b7565-frqnn"] Apr 24 21:28:42.029189 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:28:42.029132 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a194a78_5ba5_45d9_a118_d63acc7a75a2.slice/crio-eebe27ea66795798d18ea62918bfcd3338dda22ff10a8257fb0f7feb96efb79b WatchSource:0}: Error finding container eebe27ea66795798d18ea62918bfcd3338dda22ff10a8257fb0f7feb96efb79b: Status 404 returned error can't find the container with id eebe27ea66795798d18ea62918bfcd3338dda22ff10a8257fb0f7feb96efb79b Apr 24 21:28:42.109087 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.109066 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.135959 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.135885 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.135959 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.135924 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.135959 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.135945 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.135969 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.135994 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136027 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136063 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136088 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136118 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136154 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl9fq\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136179 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136210 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136208 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136259 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136297 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136333 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136373 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136408 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136661 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136433 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config\") pod \"255c4b61-2bab-4d03-9871-8c819a38b3e5\" (UID: \"255c4b61-2bab-4d03-9871-8c819a38b3e5\") " Apr 24 21:28:42.136946 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136706 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 21:28:42.136946 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.136910 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-db\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.137146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.137069 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:42.137146 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.137095 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:42.138229 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.138197 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:42.138340 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.138240 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:42.138905 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.138861 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:28:42.139754 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.139720 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.139946 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.139919 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.141114 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.141082 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:42.141333 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.141305 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.141429 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.141409 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out" (OuterVolumeSpecName: "config-out") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 21:28:42.141531 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.141501 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config" (OuterVolumeSpecName: "config") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.141662 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.141569 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.142103 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.142074 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.142830 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.142758 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.144212 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.144187 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.144212 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.144202 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq" (OuterVolumeSpecName: "kube-api-access-wl9fq") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "kube-api-access-wl9fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:28:42.156538 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.156500 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config" (OuterVolumeSpecName: "web-config") pod "255c4b61-2bab-4d03-9871-8c819a38b3e5" (UID: "255c4b61-2bab-4d03-9871-8c819a38b3e5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:28:42.202739 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202706 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" exitCode=0 Apr 24 21:28:42.202739 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202733 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" exitCode=0 Apr 24 21:28:42.202739 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202742 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" exitCode=0 Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202751 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" exitCode=0 Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202758 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" exitCode=0 Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202765 2571 generic.go:358] "Generic (PLEG): container finished" podID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" exitCode=0 Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202801 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202848 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202864 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202868 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202878 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202896 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202911 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202925 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"255c4b61-2bab-4d03-9871-8c819a38b3e5","Type":"ContainerDied","Data":"239e45d21024a858afde35c12af247e9e0a7abae00887c0b1d903f3e933ce8cf"} Apr 24 21:28:42.203246 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.202935 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.204159 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.204126 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" event={"ID":"5a194a78-5ba5-45d9-a118-d63acc7a75a2","Type":"ContainerStarted","Data":"eebe27ea66795798d18ea62918bfcd3338dda22ff10a8257fb0f7feb96efb79b"} Apr 24 21:28:42.212393 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.212376 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.220061 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.220039 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.226795 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.226779 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.233068 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.233052 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.236100 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.236077 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:42.237734 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237711 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237740 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl9fq\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-kube-api-access-wl9fq\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237756 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237782 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237797 2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-kube-rbac-proxy\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237812 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.237842 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237829 2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237845 2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237859 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/255c4b61-2bab-4d03-9871-8c819a38b3e5-tls-assets\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237880 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-web-config\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237896 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237911 2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-grpc-tls\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237925 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237940 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237955 2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/255c4b61-2bab-4d03-9871-8c819a38b3e5-secret-metrics-client-certs\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237970 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/255c4b61-2bab-4d03-9871-8c819a38b3e5-configmap-metrics-client-ca\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.238143 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.237984 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/255c4b61-2bab-4d03-9871-8c819a38b3e5-config-out\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:28:42.240632 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.240615 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.246355 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.246328 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:42.248709 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.248695 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.255047 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.255030 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.255344 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.255325 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.255416 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.255350 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.255416 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.255381 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.255749 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.255725 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.255838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.255752 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.255838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.255766 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.256048 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.256027 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.256107 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.256058 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.256107 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.256079 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.256338 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.256322 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.256375 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.256342 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.256375 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.256356 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.259852 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.256947 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.259852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.256983 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.259852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.257042 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.260249 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.260157 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.260249 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.260195 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.260249 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.260214 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.261522 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:28:42.261496 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.261631 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.261527 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.261631 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.261542 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.261814 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.261793 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.261859 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.261815 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.262008 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.261987 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.262077 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262011 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.262239 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262221 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.262313 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262240 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.262459 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262439 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.262501 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262461 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.262777 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262739 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.262851 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.262783 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.263062 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263038 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.263129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263067 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.263381 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263335 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.263470 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263387 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.263686 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263666 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.263765 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263685 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.263900 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263885 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.263943 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.263900 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.264101 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264083 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.264167 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264103 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.264317 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264301 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.264359 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264318 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.264540 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264522 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.264577 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264542 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.264774 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264759 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.264827 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264775 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.264944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264929 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.264985 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.264944 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.265099 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265084 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.265151 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265098 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.265300 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265283 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.265300 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265299 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.265507 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265486 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.265557 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265507 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.265709 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265689 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.265748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265710 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.265901 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265881 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.265974 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.265903 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.266090 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266071 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.266136 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266091 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.266224 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266209 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.266263 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266224 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.266420 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266403 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.266469 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266420 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.266657 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266638 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.266708 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266657 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.266862 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266846 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.266912 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.266862 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.267067 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267047 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.267067 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267066 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.267270 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267250 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.267311 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267271 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.267470 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267450 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.267509 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267471 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.267718 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267701 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.267718 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267718 2571 scope.go:117] "RemoveContainer" containerID="fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a" Apr 24 21:28:42.267944 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267923 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a"} err="failed to get container status \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": rpc error: code = NotFound desc = could not find container \"fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a\": container with ID starting with fb1a9c1ef812b3931ae9a8f74dfdd177e105944b66eb1fb0d6462d16a6417a2a not found: ID does not exist" Apr 24 21:28:42.267988 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.267946 2571 scope.go:117] "RemoveContainer" containerID="965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6" Apr 24 21:28:42.268232 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268205 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6"} err="failed to get container status \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": rpc error: code = NotFound desc = could not find container \"965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6\": container with ID starting with 965008d61254c758ee9402bbf75f96267a1ae932c6e8e7138d9518c21417a4b6 not found: ID does not exist" Apr 24 21:28:42.268232 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268232 2571 scope.go:117] "RemoveContainer" containerID="12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16" Apr 24 21:28:42.268454 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268435 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16"} err="failed to get container status \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": rpc error: code = NotFound desc = could not find container \"12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16\": container with ID starting with 12a965be9c8b9aeca2b1f43c86a3320c342c1e258f2810e348676860cf325d16 not found: ID does not exist" Apr 24 21:28:42.268537 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268456 2571 scope.go:117] "RemoveContainer" containerID="5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736" Apr 24 21:28:42.268747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268724 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736"} err="failed to get container status \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": rpc error: code = NotFound desc = could not find container \"5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736\": container with ID starting with 5fbef91a2f3a8b292d9215a338a5941d56d600f2654906091954047c6d03b736 not found: ID does not exist" Apr 24 21:28:42.268747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268747 2571 scope.go:117] "RemoveContainer" containerID="0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b" Apr 24 21:28:42.268985 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268967 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b"} err="failed to get container status \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": rpc error: code = NotFound desc = could not find container \"0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b\": container with ID starting with 0799dfcc28a8934e0c865a08180f352d94810f579d84dd7702f5510b6aaf717b not found: ID does not exist" Apr 24 21:28:42.268985 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.268985 2571 scope.go:117] "RemoveContainer" containerID="5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168" Apr 24 21:28:42.269178 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.269158 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168"} err="failed to get container status \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": rpc error: code = NotFound desc = could not find container \"5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168\": container with ID starting with 5cbedf5769560cd40470a6567084e6c5e4fa9c61f55aea2de680cbc94018b168 not found: ID does not exist" Apr 24 21:28:42.269218 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.269181 2571 scope.go:117] "RemoveContainer" containerID="4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160" Apr 24 21:28:42.269412 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.269393 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160"} err="failed to get container status \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": rpc error: code = NotFound desc = could not find container \"4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160\": container with ID starting with 4bd478b657597affc1535736cc8619e053a964acb59fa899ec6bee3822196160 not found: ID does not exist" Apr 24 21:28:42.279305 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279285 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:42.279597 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279575 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="thanos-sidecar" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279601 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="thanos-sidecar" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279611 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-web" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279616 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-web" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279626 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="init-config-reloader" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279631 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="init-config-reloader" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279639 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="config-reloader" Apr 24 21:28:42.279644 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279644 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="config-reloader" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279653 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="prometheus" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279658 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="prometheus" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279667 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279673 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279682 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-thanos" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279687 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-thanos" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279728 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="prometheus" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279736 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="config-reloader" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279743 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279751 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="thanos-sidecar" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279755 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-web" Apr 24 21:28:42.279834 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.279761 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" containerName="kube-rbac-proxy-thanos" Apr 24 21:28:42.285152 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.285134 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.288795 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.288734 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 24 21:28:42.288907 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.288795 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 24 21:28:42.288907 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.288885 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 24 21:28:42.289173 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.289156 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 24 21:28:42.289791 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.289732 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 24 21:28:42.289791 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.289773 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 24 21:28:42.290087 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.289836 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 24 21:28:42.290087 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.289928 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f5pv6\"" Apr 24 21:28:42.290087 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.290005 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3an8b0p3s7ri9\"" Apr 24 21:28:42.290899 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.290881 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 24 21:28:42.291004 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.290940 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 24 21:28:42.291100 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.291006 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 24 21:28:42.292802 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.292781 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 24 21:28:42.296686 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.296669 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 24 21:28:42.305665 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.305646 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:42.338443 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338412 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338457 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338511 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338553 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338541 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338601 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338628 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338665 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338687 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338711 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338734 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338757 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338791 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338808 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.338838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338822 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.339028 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338851 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.339028 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338886 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.339028 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338921 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8ww\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-kube-api-access-2s8ww\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.339028 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.338951 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.439828 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439794 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.439969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439843 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.439969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439888 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.439969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439923 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.439969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439949 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.439978 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440017 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440054 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440079 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440102 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440141 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440171 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440210 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8ww\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-kube-api-access-2s8ww\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.440251 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440247 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440278 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440314 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440336 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440366 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441117 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.440736 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.441541 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.441515 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.442987 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.442161 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.442987 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.442741 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.443612 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.443449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444187 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444259 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc12d4e1-9383-43f3-ae97-81d39acefad9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444371 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc12d4e1-9383-43f3-ae97-81d39acefad9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444407 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.444848 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.444797 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.446563 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.446540 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.446563 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.446559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.447078 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.447051 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.448149 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.448130 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-config\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.448345 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.448328 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.448483 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.448459 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc12d4e1-9383-43f3-ae97-81d39acefad9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.450043 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.450025 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8ww\" (UniqueName: \"kubernetes.io/projected/fc12d4e1-9383-43f3-ae97-81d39acefad9-kube-api-access-2s8ww\") pod \"prometheus-k8s-0\" (UID: \"fc12d4e1-9383-43f3-ae97-81d39acefad9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.594954 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.594885 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:28:42.693878 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.693808 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255c4b61-2bab-4d03-9871-8c819a38b3e5" path="/var/lib/kubelet/pods/255c4b61-2bab-4d03-9871-8c819a38b3e5/volumes" Apr 24 21:28:42.738265 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:42.738210 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:28:42.743472 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:28:42.743438 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc12d4e1_9383_43f3_ae97_81d39acefad9.slice/crio-949dbfb48670524d064ebe19c5410018d600723bca77de283fb2c7fbe61cee30 WatchSource:0}: Error finding container 949dbfb48670524d064ebe19c5410018d600723bca77de283fb2c7fbe61cee30: Status 404 returned error can't find the container with id 949dbfb48670524d064ebe19c5410018d600723bca77de283fb2c7fbe61cee30 Apr 24 21:28:43.211451 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:43.211410 2571 generic.go:358] "Generic (PLEG): container finished" podID="fc12d4e1-9383-43f3-ae97-81d39acefad9" containerID="d6e6df70446a72f8728100470ec296c9020610b4e56d1aae4118b5e05f06d1e8" exitCode=0 Apr 24 21:28:43.211923 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:43.211457 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerDied","Data":"d6e6df70446a72f8728100470ec296c9020610b4e56d1aae4118b5e05f06d1e8"} Apr 24 21:28:43.211923 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:43.211506 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"949dbfb48670524d064ebe19c5410018d600723bca77de283fb2c7fbe61cee30"} Apr 24 21:28:44.217649 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217604 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"6c4978b5aa354d0d0ba3ef16b566de28154a1540917315951576e0c2fc999843"} Apr 24 21:28:44.217649 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217651 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"ae4a1945c808490ae302eb9a465f932cf57173730725cc72080d16f3a249e39f"} Apr 24 21:28:44.218129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217665 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"8b73ac8526f7ff8f1fccc011bc55a4e58ccbfdd7f8724b0b2e498e89c4a750a2"} Apr 24 21:28:44.218129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217678 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"b55dff273fa085527586fefa2d255fd48f5449d36b88ee59fc98ee9b1d2c1946"} Apr 24 21:28:44.218129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217688 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"cfd3c2960a62f482ad992c891b749022a3d360ac50703e18526937e06780770a"} Apr 24 21:28:44.218129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.217699 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc12d4e1-9383-43f3-ae97-81d39acefad9","Type":"ContainerStarted","Data":"ae4269d4584dee162dfcdc7beb07dcd1888b82bd5a58f40d23f9cbecb07b4e13"} Apr 24 21:28:44.219482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.219456 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" event={"ID":"5a194a78-5ba5-45d9-a118-d63acc7a75a2","Type":"ContainerStarted","Data":"1b958e949f6c64048a1d97a04bd8d4f84ce57348f33f9ba02e1dfd0e48b9f592"} Apr 24 21:28:44.219624 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.219486 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" event={"ID":"5a194a78-5ba5-45d9-a118-d63acc7a75a2","Type":"ContainerStarted","Data":"e317046bfea353a78737411d2fb0e0ee810275e90cb378c9aa2ca2ab8ff1c3b6"} Apr 24 21:28:44.219624 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.219495 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" event={"ID":"5a194a78-5ba5-45d9-a118-d63acc7a75a2","Type":"ContainerStarted","Data":"2b624830dbafb13199bbbf2f2e42c30cc4fee3d9f0dfd1036d20050cd3c6f5f4"} Apr 24 21:28:44.249609 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.249528 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.24951241 podStartE2EDuration="2.24951241s" podCreationTimestamp="2026-04-24 21:28:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:28:44.246778951 +0000 UTC m=+108.101538654" watchObservedRunningTime="2026-04-24 21:28:44.24951241 +0000 UTC m=+108.104272099" Apr 24 21:28:44.269468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:44.269426 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-cf78b7565-frqnn" podStartSLOduration=1.848365104 podStartE2EDuration="3.269413047s" podCreationTimestamp="2026-04-24 21:28:41 +0000 UTC" firstStartedPulling="2026-04-24 21:28:42.031356097 +0000 UTC m=+105.886115766" lastFinishedPulling="2026-04-24 21:28:43.452404038 +0000 UTC m=+107.307163709" observedRunningTime="2026-04-24 21:28:44.267200187 +0000 UTC m=+108.121959875" watchObservedRunningTime="2026-04-24 21:28:44.269413047 +0000 UTC m=+108.124172737" Apr 24 21:28:47.595763 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:28:47.595714 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:29:42.595548 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:29:42.595474 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:29:42.611192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:29:42.611168 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:29:43.416138 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:29:43.416105 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:30:24.714903 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.714871 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d2mg9"] Apr 24 21:30:24.718294 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.718270 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.720994 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.720972 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 24 21:30:24.732828 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.732805 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2mg9"] Apr 24 21:30:24.794290 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.794250 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-dbus\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.794456 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.794363 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-original-pull-secret\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.794456 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.794404 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-kubelet-config\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.895762 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.895728 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-original-pull-secret\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.895932 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.895774 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-kubelet-config\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.895932 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.895804 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-dbus\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.895932 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.895873 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-kubelet-config\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.895932 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.895928 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-dbus\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:24.898088 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:24.898062 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29e8bd3a-6d9e-4d41-b407-68dbb743e5ef-original-pull-secret\") pod \"global-pull-secret-syncer-d2mg9\" (UID: \"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef\") " pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:25.027227 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:25.027147 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mg9" Apr 24 21:30:25.153400 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:25.153374 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2mg9"] Apr 24 21:30:25.155398 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:30:25.155369 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e8bd3a_6d9e_4d41_b407_68dbb743e5ef.slice/crio-58cd442473ceee814df8a7ce8abade0bdae0ea2969de492e37b54de054b4c415 WatchSource:0}: Error finding container 58cd442473ceee814df8a7ce8abade0bdae0ea2969de492e37b54de054b4c415: Status 404 returned error can't find the container with id 58cd442473ceee814df8a7ce8abade0bdae0ea2969de492e37b54de054b4c415 Apr 24 21:30:25.520213 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:25.520183 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2mg9" event={"ID":"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef","Type":"ContainerStarted","Data":"58cd442473ceee814df8a7ce8abade0bdae0ea2969de492e37b54de054b4c415"} Apr 24 21:30:29.538362 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:29.538324 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2mg9" event={"ID":"29e8bd3a-6d9e-4d41-b407-68dbb743e5ef","Type":"ContainerStarted","Data":"24159817e9f368d90c5770f1226ad5de791682114889a02032fc722f330b3391"} Apr 24 21:30:29.556127 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:30:29.556082 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2mg9" podStartSLOduration=2.0398571 podStartE2EDuration="5.556068642s" podCreationTimestamp="2026-04-24 21:30:24 +0000 UTC" firstStartedPulling="2026-04-24 21:30:25.157098722 +0000 UTC m=+209.011858390" lastFinishedPulling="2026-04-24 21:30:28.673310251 +0000 UTC m=+212.528069932" observedRunningTime="2026-04-24 21:30:29.555207923 +0000 UTC m=+213.409967612" watchObservedRunningTime="2026-04-24 21:30:29.556068642 +0000 UTC m=+213.410828330" Apr 24 21:31:56.572855 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:31:56.572825 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:31:56.574097 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:31:56.574062 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:31:56.579359 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:31:56.579344 2571 kubelet.go:1628] "Image garbage collection succeeded" Apr 24 21:32:27.933838 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.933808 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ww6p8"] Apr 24 21:32:27.937110 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.937094 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:27.944608 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.944568 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vl9w8\"" Apr 24 21:32:27.945599 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.945562 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Apr 24 21:32:27.945656 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.945564 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Apr 24 21:32:27.958840 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:27.958817 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ww6p8"] Apr 24 21:32:28.021413 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.021385 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmd5\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-kube-api-access-htmd5\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.021537 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.021437 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.122104 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.122081 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htmd5\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-kube-api-access-htmd5\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.122229 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.122119 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.145202 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.145178 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmd5\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-kube-api-access-htmd5\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.146629 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.146611 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd3c032-bc11-4b70-8d6b-e94857ebc24a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ww6p8\" (UID: \"dfd3c032-bc11-4b70-8d6b-e94857ebc24a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.256874 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.256817 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" Apr 24 21:32:28.404560 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:32:28.404515 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfd3c032_bc11_4b70_8d6b_e94857ebc24a.slice/crio-21c01130c7aaf072cb0eff8de3671b6fbaca5000b5be8d4a562584a0c865cc00 WatchSource:0}: Error finding container 21c01130c7aaf072cb0eff8de3671b6fbaca5000b5be8d4a562584a0c865cc00: Status 404 returned error can't find the container with id 21c01130c7aaf072cb0eff8de3671b6fbaca5000b5be8d4a562584a0c865cc00 Apr 24 21:32:28.406564 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.406540 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 21:32:28.406847 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.406808 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ww6p8"] Apr 24 21:32:28.880788 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:28.880742 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" event={"ID":"dfd3c032-bc11-4b70-8d6b-e94857ebc24a","Type":"ContainerStarted","Data":"21c01130c7aaf072cb0eff8de3671b6fbaca5000b5be8d4a562584a0c865cc00"} Apr 24 21:32:29.696537 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.696497 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-frvsh"] Apr 24 21:32:29.700274 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.700216 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.707380 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.707355 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7bjxh\"" Apr 24 21:32:29.723890 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.723860 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-frvsh"] Apr 24 21:32:29.736165 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.736133 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.736297 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.736271 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnszc\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-kube-api-access-nnszc\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.837706 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.837669 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.837884 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.837777 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnszc\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-kube-api-access-nnszc\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.850610 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.850473 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnszc\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-kube-api-access-nnszc\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:29.851906 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:29.851878 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa34ccf9-e337-4fe7-8b15-dccbcec92e8f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-frvsh\" (UID: \"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:30.012965 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:30.012875 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:31.448919 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.448817 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-frvsh"] Apr 24 21:32:31.451571 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:32:31.451540 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa34ccf9_e337_4fe7_8b15_dccbcec92e8f.slice/crio-28243fa63604da1ca6b811840d2074d4f5ddf16be11a872dcb6f99254ec08a5f WatchSource:0}: Error finding container 28243fa63604da1ca6b811840d2074d4f5ddf16be11a872dcb6f99254ec08a5f: Status 404 returned error can't find the container with id 28243fa63604da1ca6b811840d2074d4f5ddf16be11a872dcb6f99254ec08a5f Apr 24 21:32:31.892462 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.892430 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" event={"ID":"dfd3c032-bc11-4b70-8d6b-e94857ebc24a","Type":"ContainerStarted","Data":"2eb4fecfdb5d34caa54a405dc05bd5c2b70c2a75cdd79e8705fe2cc24a471348"} Apr 24 21:32:31.893852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.893823 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" event={"ID":"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f","Type":"ContainerStarted","Data":"3644c07ecd1c677ed06413576ecc1bf92d4d2c1c16eaeb0ea80f6cef86977c72"} Apr 24 21:32:31.893852 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.893852 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" event={"ID":"aa34ccf9-e337-4fe7-8b15-dccbcec92e8f","Type":"ContainerStarted","Data":"28243fa63604da1ca6b811840d2074d4f5ddf16be11a872dcb6f99254ec08a5f"} Apr 24 21:32:31.894006 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.893909 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:32:31.911365 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.911318 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-ww6p8" podStartSLOduration=1.9243722970000001 podStartE2EDuration="4.911306822s" podCreationTimestamp="2026-04-24 21:32:27 +0000 UTC" firstStartedPulling="2026-04-24 21:32:28.406702687 +0000 UTC m=+332.261462354" lastFinishedPulling="2026-04-24 21:32:31.393637208 +0000 UTC m=+335.248396879" observedRunningTime="2026-04-24 21:32:31.909754609 +0000 UTC m=+335.764514299" watchObservedRunningTime="2026-04-24 21:32:31.911306822 +0000 UTC m=+335.766066512" Apr 24 21:32:31.931607 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:31.929559 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" podStartSLOduration=2.9295429410000002 podStartE2EDuration="2.929542941s" podCreationTimestamp="2026-04-24 21:32:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:32:31.926833643 +0000 UTC m=+335.781593332" watchObservedRunningTime="2026-04-24 21:32:31.929542941 +0000 UTC m=+335.784302632" Apr 24 21:32:35.396717 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.396676 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6568"] Apr 24 21:32:35.400085 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.400066 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.402468 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.402451 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gk67r\"" Apr 24 21:32:35.409437 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.409415 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6568"] Apr 24 21:32:35.494619 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.494568 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.494746 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.494700 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw6t\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-kube-api-access-rrw6t\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.596047 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.596003 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw6t\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-kube-api-access-rrw6t\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.596161 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.596071 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.604449 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.604425 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw6t\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-kube-api-access-rrw6t\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.604541 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.604428 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/756fdc23-9230-4fc8-b6fb-81d9f56390e4-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6568\" (UID: \"756fdc23-9230-4fc8-b6fb-81d9f56390e4\") " pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.709388 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.709365 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-b6568" Apr 24 21:32:35.829845 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.829816 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6568"] Apr 24 21:32:35.832194 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:32:35.832166 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod756fdc23_9230_4fc8_b6fb_81d9f56390e4.slice/crio-f1dfb9f85835d0b777a40849f9ff3cc58390e752be00900d44b211870b028f50 WatchSource:0}: Error finding container f1dfb9f85835d0b777a40849f9ff3cc58390e752be00900d44b211870b028f50: Status 404 returned error can't find the container with id f1dfb9f85835d0b777a40849f9ff3cc58390e752be00900d44b211870b028f50 Apr 24 21:32:35.906945 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.906914 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-b6568" event={"ID":"756fdc23-9230-4fc8-b6fb-81d9f56390e4","Type":"ContainerStarted","Data":"9bd2679d5bdd53657bc87046522305633c7ce097f07f3bce833f5455341f4296"} Apr 24 21:32:35.907123 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.906952 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-b6568" event={"ID":"756fdc23-9230-4fc8-b6fb-81d9f56390e4","Type":"ContainerStarted","Data":"f1dfb9f85835d0b777a40849f9ff3cc58390e752be00900d44b211870b028f50"} Apr 24 21:32:35.935908 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:35.935857 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-b6568" podStartSLOduration=0.935842575 podStartE2EDuration="935.842575ms" podCreationTimestamp="2026-04-24 21:32:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:32:35.934338966 +0000 UTC m=+339.789098655" watchObservedRunningTime="2026-04-24 21:32:35.935842575 +0000 UTC m=+339.790602263" Apr 24 21:32:37.899155 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:32:37.899081 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-frvsh" Apr 24 21:33:04.964278 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.964243 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p"] Apr 24 21:33:04.971487 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.971472 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:04.974602 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.974570 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Apr 24 21:33:04.975800 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.975776 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Apr 24 21:33:04.975800 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.975797 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Apr 24 21:33:04.975950 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.975783 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Apr 24 21:33:04.975950 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.975786 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vrpjh\"" Apr 24 21:33:04.975950 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.975775 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Apr 24 21:33:04.980453 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:04.980434 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p"] Apr 24 21:33:05.046103 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.046074 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.046103 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.046106 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdkm\" (UniqueName: \"kubernetes.io/projected/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-kube-api-access-pwdkm\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.046323 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.046131 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-manager-config\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.046323 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.046215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-metrics-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.146940 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.146912 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.147097 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.146944 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdkm\" (UniqueName: \"kubernetes.io/projected/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-kube-api-access-pwdkm\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.147097 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.146968 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-manager-config\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.147097 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.147004 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-metrics-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.147799 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.147743 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-manager-config\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.150404 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.150377 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.151779 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.151753 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-metrics-cert\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.158269 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.158239 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdkm\" (UniqueName: \"kubernetes.io/projected/a04b4b13-34ad-46fa-bb9e-f1c66ca639c8-kube-api-access-pwdkm\") pod \"lws-controller-manager-798cfdf8b-58l5p\" (UID: \"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8\") " pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.281227 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.281139 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:05.410985 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:05.410961 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p"] Apr 24 21:33:05.413694 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:33:05.413658 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04b4b13_34ad_46fa_bb9e_f1c66ca639c8.slice/crio-7c7f8cfc2f8727bff11494d4ea53b2d4bd91ccb52325c53ed51ee3e8f4206a50 WatchSource:0}: Error finding container 7c7f8cfc2f8727bff11494d4ea53b2d4bd91ccb52325c53ed51ee3e8f4206a50: Status 404 returned error can't find the container with id 7c7f8cfc2f8727bff11494d4ea53b2d4bd91ccb52325c53ed51ee3e8f4206a50 Apr 24 21:33:06.000653 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:06.000617 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" event={"ID":"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8","Type":"ContainerStarted","Data":"7c7f8cfc2f8727bff11494d4ea53b2d4bd91ccb52325c53ed51ee3e8f4206a50"} Apr 24 21:33:08.007902 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:08.007867 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" event={"ID":"a04b4b13-34ad-46fa-bb9e-f1c66ca639c8","Type":"ContainerStarted","Data":"480cd709aee63d01a9d2d125b09dd0554e23beb5c2428f1107497cf681fd0890"} Apr 24 21:33:08.008310 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:08.007991 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:08.048414 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:08.048313 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" podStartSLOduration=1.6804299710000001 podStartE2EDuration="4.04829902s" podCreationTimestamp="2026-04-24 21:33:04 +0000 UTC" firstStartedPulling="2026-04-24 21:33:05.415833007 +0000 UTC m=+369.270592675" lastFinishedPulling="2026-04-24 21:33:07.783702051 +0000 UTC m=+371.638461724" observedRunningTime="2026-04-24 21:33:08.046544706 +0000 UTC m=+371.901304395" watchObservedRunningTime="2026-04-24 21:33:08.04829902 +0000 UTC m=+371.903058712" Apr 24 21:33:19.014308 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:19.014277 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-798cfdf8b-58l5p" Apr 24 21:33:56.495409 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.495373 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d5cf6bcc-nr8ql"] Apr 24 21:33:56.499323 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.499303 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.503803 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.503781 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 24 21:33:56.509360 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.509341 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 24 21:33:56.509456 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.509398 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 24 21:33:56.510441 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.510414 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 24 21:33:56.510541 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.510483 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bdp6p\"" Apr 24 21:33:56.510541 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.510529 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 24 21:33:56.510747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.510612 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 24 21:33:56.510747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.510623 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 24 21:33:56.514232 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.514214 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 24 21:33:56.517794 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.517775 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5cf6bcc-nr8ql"] Apr 24 21:33:56.588342 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588317 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-service-ca\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588368 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-trusted-ca-bundle\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588409 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-oauth-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588482 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588598 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588490 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-oauth-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588598 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfg4\" (UniqueName: \"kubernetes.io/projected/6ce781c3-f3a5-48ed-974c-eae88a54d22c-kube-api-access-lxfg4\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.588598 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.588536 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689359 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689327 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-service-ca\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689534 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689423 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-trusted-ca-bundle\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689534 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689464 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-oauth-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689534 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689497 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689534 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689523 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-oauth-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689823 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689548 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfg4\" (UniqueName: \"kubernetes.io/projected/6ce781c3-f3a5-48ed-974c-eae88a54d22c-kube-api-access-lxfg4\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.689823 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.689579 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.692090 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.692067 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 24 21:33:56.692230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.692068 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 24 21:33:56.692230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.692072 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 24 21:33:56.692373 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.692254 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 24 21:33:56.692453 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.692441 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 24 21:33:56.697937 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.697921 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 24 21:33:56.699129 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.699113 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 24 21:33:56.700538 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.700494 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.700646 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.700536 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-oauth-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.700909 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.700888 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-service-ca\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.700951 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.700913 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce781c3-f3a5-48ed-974c-eae88a54d22c-trusted-ca-bundle\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.702285 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.702266 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-serving-cert\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.702421 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.702402 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ce781c3-f3a5-48ed-974c-eae88a54d22c-console-oauth-config\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.709858 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.709817 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 24 21:33:56.719433 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.719412 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfg4\" (UniqueName: \"kubernetes.io/projected/6ce781c3-f3a5-48ed-974c-eae88a54d22c-kube-api-access-lxfg4\") pod \"console-55d5cf6bcc-nr8ql\" (UID: \"6ce781c3-f3a5-48ed-974c-eae88a54d22c\") " pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.811747 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.811690 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bdp6p\"" Apr 24 21:33:56.819338 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.819324 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:33:56.951214 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:56.951191 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5cf6bcc-nr8ql"] Apr 24 21:33:56.953690 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:33:56.953661 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce781c3_f3a5_48ed_974c_eae88a54d22c.slice/crio-0001a5051151a3bc284fc506129b66a7a16e7b3ab299e8238cfa224b8fd1a3fa WatchSource:0}: Error finding container 0001a5051151a3bc284fc506129b66a7a16e7b3ab299e8238cfa224b8fd1a3fa: Status 404 returned error can't find the container with id 0001a5051151a3bc284fc506129b66a7a16e7b3ab299e8238cfa224b8fd1a3fa Apr 24 21:33:57.155549 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:57.155462 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5cf6bcc-nr8ql" event={"ID":"6ce781c3-f3a5-48ed-974c-eae88a54d22c","Type":"ContainerStarted","Data":"d85f79c9deef1d8d076dc6b44bb65caac096a6dad4b0bfaa023e05aa01e517b3"} Apr 24 21:33:57.155549 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:57.155501 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5cf6bcc-nr8ql" event={"ID":"6ce781c3-f3a5-48ed-974c-eae88a54d22c","Type":"ContainerStarted","Data":"0001a5051151a3bc284fc506129b66a7a16e7b3ab299e8238cfa224b8fd1a3fa"} Apr 24 21:33:57.175679 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:33:57.175631 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55d5cf6bcc-nr8ql" podStartSLOduration=1.175616566 podStartE2EDuration="1.175616566s" podCreationTimestamp="2026-04-24 21:33:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:33:57.173198784 +0000 UTC m=+421.027958485" watchObservedRunningTime="2026-04-24 21:33:57.175616566 +0000 UTC m=+421.030376254" Apr 24 21:34:06.820514 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:06.820482 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:34:06.820514 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:06.820520 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:34:06.825090 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:06.825068 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:34:07.193916 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:07.193886 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d5cf6bcc-nr8ql" Apr 24 21:34:11.330460 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.330424 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2"] Apr 24 21:34:11.333733 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.333718 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.339667 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.339641 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Apr 24 21:34:11.339803 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.339643 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Apr 24 21:34:11.339803 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.339762 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7lqcb\"" Apr 24 21:34:11.362959 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.362932 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2"] Apr 24 21:34:11.419513 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.419475 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8v6\" (UniqueName: \"kubernetes.io/projected/fdfce710-26f5-441a-9a65-4373321347f8-kube-api-access-pt8v6\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.419696 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.419615 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfce710-26f5-441a-9a65-4373321347f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.520982 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.520944 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8v6\" (UniqueName: \"kubernetes.io/projected/fdfce710-26f5-441a-9a65-4373321347f8-kube-api-access-pt8v6\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.521149 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.521051 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfce710-26f5-441a-9a65-4373321347f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.521330 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.521314 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfce710-26f5-441a-9a65-4373321347f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.542421 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.542397 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8v6\" (UniqueName: \"kubernetes.io/projected/fdfce710-26f5-441a-9a65-4373321347f8-kube-api-access-pt8v6\") pod \"kuadrant-operator-controller-manager-6ddf9554fc-2t8s2\" (UID: \"fdfce710-26f5-441a-9a65-4373321347f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.644656 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.644556 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:11.845555 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:11.845527 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2"] Apr 24 21:34:11.848845 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:34:11.848816 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfce710_26f5_441a_9a65_4373321347f8.slice/crio-9f9ce74dc96901921b70635d86072e044edc314ca68d00ae5a9b4bfb03d17462 WatchSource:0}: Error finding container 9f9ce74dc96901921b70635d86072e044edc314ca68d00ae5a9b4bfb03d17462: Status 404 returned error can't find the container with id 9f9ce74dc96901921b70635d86072e044edc314ca68d00ae5a9b4bfb03d17462 Apr 24 21:34:12.207156 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:12.207122 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" event={"ID":"fdfce710-26f5-441a-9a65-4373321347f8","Type":"ContainerStarted","Data":"9f9ce74dc96901921b70635d86072e044edc314ca68d00ae5a9b4bfb03d17462"} Apr 24 21:34:17.228836 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:17.228792 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" event={"ID":"fdfce710-26f5-441a-9a65-4373321347f8","Type":"ContainerStarted","Data":"47cc6421217d27ba162b8bb973296e8c70733e3a860f75cba593d2402fde16ff"} Apr 24 21:34:17.229348 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:17.228954 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:34:17.277789 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:17.277737 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" podStartSLOduration=1.907845469 podStartE2EDuration="6.277722472s" podCreationTimestamp="2026-04-24 21:34:11 +0000 UTC" firstStartedPulling="2026-04-24 21:34:11.851165962 +0000 UTC m=+435.705925632" lastFinishedPulling="2026-04-24 21:34:16.221042965 +0000 UTC m=+440.075802635" observedRunningTime="2026-04-24 21:34:17.27651476 +0000 UTC m=+441.131274450" watchObservedRunningTime="2026-04-24 21:34:17.277722472 +0000 UTC m=+441.132482161" Apr 24 21:34:28.234432 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:34:28.234400 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-2t8s2" Apr 24 21:35:02.933831 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:02.933791 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:02.940803 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:02.940778 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:02.943899 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:02.943875 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Apr 24 21:35:02.943899 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:02.943884 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ps4w2\"" Apr 24 21:35:02.952023 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:02.951997 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:03.052679 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.052638 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rssdz\" (UniqueName: \"kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.052679 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.052680 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.072963 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.072925 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:03.153491 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.153463 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rssdz\" (UniqueName: \"kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.153491 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.153498 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.154168 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.154149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.163607 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.163566 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rssdz\" (UniqueName: \"kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz\") pod \"limitador-limitador-64c8f475fb-7tngz\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.253297 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.253195 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:03.380270 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:03.380248 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:03.382950 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:35:03.382898 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057e4f42_df67_420e_92e2_bd1fe8a76d30.slice/crio-7ce9059b377d7fd677a9924608bae4dfc604dce39f9458c53e970dcbbd2c8459 WatchSource:0}: Error finding container 7ce9059b377d7fd677a9924608bae4dfc604dce39f9458c53e970dcbbd2c8459: Status 404 returned error can't find the container with id 7ce9059b377d7fd677a9924608bae4dfc604dce39f9458c53e970dcbbd2c8459 Apr 24 21:35:04.390664 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:04.390624 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" event={"ID":"057e4f42-df67-420e-92e2-bd1fe8a76d30","Type":"ContainerStarted","Data":"7ce9059b377d7fd677a9924608bae4dfc604dce39f9458c53e970dcbbd2c8459"} Apr 24 21:35:07.403818 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:07.403773 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" event={"ID":"057e4f42-df67-420e-92e2-bd1fe8a76d30","Type":"ContainerStarted","Data":"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2"} Apr 24 21:35:07.404192 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:07.403933 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:07.435823 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:07.435775 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" podStartSLOduration=1.641598964 podStartE2EDuration="5.435760947s" podCreationTimestamp="2026-04-24 21:35:02 +0000 UTC" firstStartedPulling="2026-04-24 21:35:03.384728815 +0000 UTC m=+487.239488483" lastFinishedPulling="2026-04-24 21:35:07.178890799 +0000 UTC m=+491.033650466" observedRunningTime="2026-04-24 21:35:07.434526366 +0000 UTC m=+491.289286055" watchObservedRunningTime="2026-04-24 21:35:07.435760947 +0000 UTC m=+491.290520633" Apr 24 21:35:18.408444 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:18.408415 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:19.218249 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.218211 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:19.218481 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.218436 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" podUID="057e4f42-df67-420e-92e2-bd1fe8a76d30" containerName="limitador" containerID="cri-o://e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2" gracePeriod=30 Apr 24 21:35:19.748681 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.748659 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:19.907510 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.907429 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file\") pod \"057e4f42-df67-420e-92e2-bd1fe8a76d30\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " Apr 24 21:35:19.907510 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.907481 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rssdz\" (UniqueName: \"kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz\") pod \"057e4f42-df67-420e-92e2-bd1fe8a76d30\" (UID: \"057e4f42-df67-420e-92e2-bd1fe8a76d30\") " Apr 24 21:35:19.907794 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.907767 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file" (OuterVolumeSpecName: "config-file") pod "057e4f42-df67-420e-92e2-bd1fe8a76d30" (UID: "057e4f42-df67-420e-92e2-bd1fe8a76d30"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:35:19.909735 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:19.909713 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz" (OuterVolumeSpecName: "kube-api-access-rssdz") pod "057e4f42-df67-420e-92e2-bd1fe8a76d30" (UID: "057e4f42-df67-420e-92e2-bd1fe8a76d30"). InnerVolumeSpecName "kube-api-access-rssdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:35:20.008617 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.008570 2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/057e4f42-df67-420e-92e2-bd1fe8a76d30-config-file\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:35:20.008617 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.008611 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rssdz\" (UniqueName: \"kubernetes.io/projected/057e4f42-df67-420e-92e2-bd1fe8a76d30-kube-api-access-rssdz\") on node \"ip-10-0-129-204.ec2.internal\" DevicePath \"\"" Apr 24 21:35:20.448321 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.448282 2571 generic.go:358] "Generic (PLEG): container finished" podID="057e4f42-df67-420e-92e2-bd1fe8a76d30" containerID="e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2" exitCode=0 Apr 24 21:35:20.448321 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.448322 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" event={"ID":"057e4f42-df67-420e-92e2-bd1fe8a76d30","Type":"ContainerDied","Data":"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2"} Apr 24 21:35:20.448572 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.448346 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" Apr 24 21:35:20.448572 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.448361 2571 scope.go:117] "RemoveContainer" containerID="e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2" Apr 24 21:35:20.448572 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.448349 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-7tngz" event={"ID":"057e4f42-df67-420e-92e2-bd1fe8a76d30","Type":"ContainerDied","Data":"7ce9059b377d7fd677a9924608bae4dfc604dce39f9458c53e970dcbbd2c8459"} Apr 24 21:35:20.457078 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.457061 2571 scope.go:117] "RemoveContainer" containerID="e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2" Apr 24 21:35:20.457335 ip-10-0-129-204 kubenswrapper[2571]: E0424 21:35:20.457319 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2\": container with ID starting with e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2 not found: ID does not exist" containerID="e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2" Apr 24 21:35:20.457397 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.457344 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2"} err="failed to get container status \"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2\": rpc error: code = NotFound desc = could not find container \"e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2\": container with ID starting with e29010cbb6fba0a870a3014152c3a3dc47ea470174e365b92dcf7e83cb276eb2 not found: ID does not exist" Apr 24 21:35:20.468188 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.468160 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:20.471675 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.471655 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-7tngz"] Apr 24 21:35:20.691209 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:20.691173 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="057e4f42-df67-420e-92e2-bd1fe8a76d30" path="/var/lib/kubelet/pods/057e4f42-df67-420e-92e2-bd1fe8a76d30/volumes" Apr 24 21:35:38.557211 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.557111 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d"] Apr 24 21:35:38.557718 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.557676 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057e4f42-df67-420e-92e2-bd1fe8a76d30" containerName="limitador" Apr 24 21:35:38.557764 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.557717 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="057e4f42-df67-420e-92e2-bd1fe8a76d30" containerName="limitador" Apr 24 21:35:38.557839 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.557827 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="057e4f42-df67-420e-92e2-bd1fe8a76d30" containerName="limitador" Apr 24 21:35:38.564118 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.564101 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.566873 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.566854 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Apr 24 21:35:38.566969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.566936 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v52jc\"" Apr 24 21:35:38.566969 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.566951 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"istio-ca-root-cert\"" Apr 24 21:35:38.567057 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.566973 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Apr 24 21:35:38.567268 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.567250 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Apr 24 21:35:38.567833 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.567821 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Apr 24 21:35:38.567886 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.567841 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Apr 24 21:35:38.572654 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.572631 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d"] Apr 24 21:35:38.670147 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670113 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670309 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670155 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-token\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670309 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670174 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670309 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670293 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670411 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670325 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdsb6\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-kube-api-access-fdsb6\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670411 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670391 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-local-certs\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.670475 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.670420 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-cacerts\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771308 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771274 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771308 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771313 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdsb6\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-kube-api-access-fdsb6\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771338 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-local-certs\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771377 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-cacerts\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771440 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771474 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-token\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.771535 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.771497 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.772253 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.772169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.774031 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.774008 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.774139 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.774012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.774282 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.774266 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-local-certs\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.774440 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.774420 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-cacerts\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.811204 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.811135 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdsb6\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-kube-api-access-fdsb6\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.815657 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.815628 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a705e5b-90b1-49e8-a8e6-c523a9e009a0-istio-token\") pod \"istiod-openshift-gateway-55ff986f96-n779d\" (UID: \"6a705e5b-90b1-49e8-a8e6-c523a9e009a0\") " pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:38.874859 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:38.874824 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:39.006534 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:39.006501 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d"] Apr 24 21:35:39.009461 ip-10-0-129-204 kubenswrapper[2571]: W0424 21:35:39.009433 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a705e5b_90b1_49e8_a8e6_c523a9e009a0.slice/crio-f7b2c03fafdf98c2f2d4b0d271e2b334c8b9d03e0f402791fa679bdcf282137b WatchSource:0}: Error finding container f7b2c03fafdf98c2f2d4b0d271e2b334c8b9d03e0f402791fa679bdcf282137b: Status 404 returned error can't find the container with id f7b2c03fafdf98c2f2d4b0d271e2b334c8b9d03e0f402791fa679bdcf282137b Apr 24 21:35:39.516620 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:39.516557 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" event={"ID":"6a705e5b-90b1-49e8-a8e6-c523a9e009a0","Type":"ContainerStarted","Data":"f7b2c03fafdf98c2f2d4b0d271e2b334c8b9d03e0f402791fa679bdcf282137b"} Apr 24 21:35:41.177304 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:41.177255 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Apr 24 21:35:41.177712 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:41.177364 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Apr 24 21:35:41.525012 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:41.524979 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" event={"ID":"6a705e5b-90b1-49e8-a8e6-c523a9e009a0","Type":"ContainerStarted","Data":"21f2664f5b861b2fe96538ad50de563bf1c9e6724f51c55f01bc821735cc66a7"} Apr 24 21:35:41.525180 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:41.525054 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:35:41.593550 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:41.593488 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" podStartSLOduration=1.427913428 podStartE2EDuration="3.593467858s" podCreationTimestamp="2026-04-24 21:35:38 +0000 UTC" firstStartedPulling="2026-04-24 21:35:39.011414409 +0000 UTC m=+522.866174076" lastFinishedPulling="2026-04-24 21:35:41.176968823 +0000 UTC m=+525.031728506" observedRunningTime="2026-04-24 21:35:41.589785567 +0000 UTC m=+525.444545257" watchObservedRunningTime="2026-04-24 21:35:41.593467858 +0000 UTC m=+525.448227548" Apr 24 21:35:42.535841 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:35:42.535813 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-55ff986f96-n779d" Apr 24 21:36:56.598932 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:36:56.598900 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:36:56.599477 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:36:56.599362 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:41:56.624633 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:41:56.624580 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:41:56.626987 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:41:56.626961 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:46:56.648888 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:46:56.648860 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:46:56.652230 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:46:56.652207 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:51:56.673877 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:51:56.673847 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:51:56.677899 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:51:56.677878 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:56:56.698748 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:56:56.698713 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 21:56:56.705849 ip-10-0-129-204 kubenswrapper[2571]: I0424 21:56:56.705830 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:01:56.722353 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:01:56.722326 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:01:56.731356 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:01:56.731333 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:04:45.280897 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.280860 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj"] Apr 24 22:04:45.284690 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.284669 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.287431 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.287403 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Apr 24 22:04:45.287547 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.287456 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"istio-ca-root-cert\"" Apr 24 22:04:45.287547 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.287514 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Apr 24 22:04:45.287547 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.287459 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-2wmsl\"" Apr 24 22:04:45.296917 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.296898 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj"] Apr 24 22:04:45.445224 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445193 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmpf\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-kube-api-access-szmpf\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445395 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445233 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445395 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445395 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445282 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445395 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445332 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445395 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445350 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/328eb169-9f36-49d3-b574-2782b8a442c2-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445557 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445409 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445557 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445433 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/328eb169-9f36-49d3-b574-2782b8a442c2-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.445557 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.445456 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546083 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546003 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546083 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546038 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/328eb169-9f36-49d3-b574-2782b8a442c2-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546083 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546072 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546343 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546114 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szmpf\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-kube-api-access-szmpf\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546343 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546143 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546343 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546264 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546499 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546417 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546499 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546422 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546643 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546508 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546643 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546550 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/328eb169-9f36-49d3-b574-2782b8a442c2-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546754 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546808 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546748 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546869 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546833 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.546869 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.546849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/328eb169-9f36-49d3-b574-2782b8a442c2-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.548626 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.548607 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/328eb169-9f36-49d3-b574-2782b8a442c2-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.549120 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.549089 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/328eb169-9f36-49d3-b574-2782b8a442c2-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.555012 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.554983 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.555112 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.555034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmpf\" (UniqueName: \"kubernetes.io/projected/328eb169-9f36-49d3-b574-2782b8a442c2-kube-api-access-szmpf\") pod \"router-gateway-2-openshift-default-6866b85949-tvbkj\" (UID: \"328eb169-9f36-49d3-b574-2782b8a442c2\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.596066 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.596036 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:45.725282 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.725257 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj"] Apr 24 22:04:45.727769 ip-10-0-129-204 kubenswrapper[2571]: W0424 22:04:45.727742 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328eb169_9f36_49d3_b574_2782b8a442c2.slice/crio-5d7bbcd498c282b3c7dd4660ccea7642956d72256e69886e3e21a868d5278133 WatchSource:0}: Error finding container 5d7bbcd498c282b3c7dd4660ccea7642956d72256e69886e3e21a868d5278133: Status 404 returned error can't find the container with id 5d7bbcd498c282b3c7dd4660ccea7642956d72256e69886e3e21a868d5278133 Apr 24 22:04:45.729682 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:45.729663 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 22:04:46.413558 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:46.413524 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" event={"ID":"328eb169-9f36-49d3-b574-2782b8a442c2","Type":"ContainerStarted","Data":"5d7bbcd498c282b3c7dd4660ccea7642956d72256e69886e3e21a868d5278133"} Apr 24 22:04:48.553107 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:48.553072 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Apr 24 22:04:48.553469 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:48.553156 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Apr 24 22:04:48.553469 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:48.553247 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Apr 24 22:04:49.426648 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:49.426558 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" event={"ID":"328eb169-9f36-49d3-b574-2782b8a442c2","Type":"ContainerStarted","Data":"6513601f8dc09310f9a187cc0848641880cb8df6db7b2bb56d0563691ed5bbd5"} Apr 24 22:04:49.596958 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:49.596919 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:49.598213 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:49.598180 2571 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" podUID="328eb169-9f36-49d3-b574-2782b8a442c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Apr 24 22:04:50.597223 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:50.597169 2571 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" podUID="328eb169-9f36-49d3-b574-2782b8a442c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Apr 24 22:04:51.600814 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:51.600785 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:51.626055 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:51.626005 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" podStartSLOduration=3.802979443 podStartE2EDuration="6.625991324s" podCreationTimestamp="2026-04-24 22:04:45 +0000 UTC" firstStartedPulling="2026-04-24 22:04:45.729820822 +0000 UTC m=+2269.584580490" lastFinishedPulling="2026-04-24 22:04:48.552832702 +0000 UTC m=+2272.407592371" observedRunningTime="2026-04-24 22:04:49.459771826 +0000 UTC m=+2273.314531515" watchObservedRunningTime="2026-04-24 22:04:51.625991324 +0000 UTC m=+2275.480751012" Apr 24 22:04:52.436908 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:52.436869 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:04:52.437987 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:04:52.437963 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-tvbkj" Apr 24 22:05:22.944055 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.944019 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-69d55c4586-mpk9p"] Apr 24 22:05:22.947356 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.947336 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:22.951260 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.951241 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-sq9nj\"" Apr 24 22:05:22.951349 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.951262 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Apr 24 22:05:22.951349 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.951270 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Apr 24 22:05:22.951349 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.951276 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Apr 24 22:05:22.961392 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:22.961371 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69d55c4586-mpk9p"] Apr 24 22:05:23.103507 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.103469 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00042ac6-1fcf-43a7-8097-4e992c24cc1f-cert\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.103712 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.103570 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqcvq\" (UniqueName: \"kubernetes.io/projected/00042ac6-1fcf-43a7-8097-4e992c24cc1f-kube-api-access-vqcvq\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.204647 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.204545 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00042ac6-1fcf-43a7-8097-4e992c24cc1f-cert\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.204647 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.204637 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqcvq\" (UniqueName: \"kubernetes.io/projected/00042ac6-1fcf-43a7-8097-4e992c24cc1f-kube-api-access-vqcvq\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.207117 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.207085 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00042ac6-1fcf-43a7-8097-4e992c24cc1f-cert\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.213596 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.213559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqcvq\" (UniqueName: \"kubernetes.io/projected/00042ac6-1fcf-43a7-8097-4e992c24cc1f-kube-api-access-vqcvq\") pod \"llmisvc-controller-manager-69d55c4586-mpk9p\" (UID: \"00042ac6-1fcf-43a7-8097-4e992c24cc1f\") " pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.257120 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.257097 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:23.378512 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.378485 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69d55c4586-mpk9p"] Apr 24 22:05:23.380514 ip-10-0-129-204 kubenswrapper[2571]: W0424 22:05:23.380485 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00042ac6_1fcf_43a7_8097_4e992c24cc1f.slice/crio-8b322d0e0f1935d3666b69a951a9a4ce041c8eaffc53ff932749b7ae07e435c7 WatchSource:0}: Error finding container 8b322d0e0f1935d3666b69a951a9a4ce041c8eaffc53ff932749b7ae07e435c7: Status 404 returned error can't find the container with id 8b322d0e0f1935d3666b69a951a9a4ce041c8eaffc53ff932749b7ae07e435c7 Apr 24 22:05:23.548761 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:23.548669 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" event={"ID":"00042ac6-1fcf-43a7-8097-4e992c24cc1f","Type":"ContainerStarted","Data":"8b322d0e0f1935d3666b69a951a9a4ce041c8eaffc53ff932749b7ae07e435c7"} Apr 24 22:05:27.566866 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:27.566825 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" event={"ID":"00042ac6-1fcf-43a7-8097-4e992c24cc1f","Type":"ContainerStarted","Data":"9c22b9e45c371cd6edbddb975282afcf8bcb18479546141d1dc15b3897b12b51"} Apr 24 22:05:27.567289 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:27.566887 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:05:27.586773 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:27.586723 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" podStartSLOduration=2.398256639 podStartE2EDuration="5.586709369s" podCreationTimestamp="2026-04-24 22:05:22 +0000 UTC" firstStartedPulling="2026-04-24 22:05:23.38176115 +0000 UTC m=+2307.236520818" lastFinishedPulling="2026-04-24 22:05:26.570213881 +0000 UTC m=+2310.424973548" observedRunningTime="2026-04-24 22:05:27.584793087 +0000 UTC m=+2311.439552813" watchObservedRunningTime="2026-04-24 22:05:27.586709369 +0000 UTC m=+2311.441469088" Apr 24 22:05:58.572361 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:05:58.572330 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-69d55c4586-mpk9p" Apr 24 22:06:56.746757 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:06:56.746730 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:06:56.757264 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:06:56.757240 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:11:56.772807 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:11:56.772727 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:11:56.783090 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:11:56.783067 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:14:28.322892 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:28.322863 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:29.287688 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:29.287657 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:30.295160 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:30.295132 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:31.287838 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:31.287792 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:32.259228 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:32.259192 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:33.238796 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:33.238766 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:34.196071 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:34.196036 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:35.155464 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:35.155430 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:36.122917 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:36.122885 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:37.068176 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:37.068133 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:38.049398 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:38.049370 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:39.032518 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:39.032465 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:40.030188 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:40.030156 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:41.058568 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:41.058533 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-tvbkj_328eb169-9f36-49d3-b574-2782b8a442c2/istio-proxy/0.log" Apr 24 22:14:42.069298 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:42.069269 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-55ff986f96-n779d_6a705e5b-90b1-49e8-a8e6-c523a9e009a0/discovery/0.log" Apr 24 22:14:42.904207 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:42.904183 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-55ff986f96-n779d_6a705e5b-90b1-49e8-a8e6-c523a9e009a0/discovery/0.log" Apr 24 22:14:43.782433 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:43.782392 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-6ddf9554fc-2t8s2_fdfce710-26f5-441a-9a65-4373321347f8/manager/0.log" Apr 24 22:14:48.987651 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:48.987612 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2mg9_29e8bd3a-6d9e-4d41-b407-68dbb743e5ef/global-pull-secret-syncer/0.log" Apr 24 22:14:49.108493 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:49.108448 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cl2mg_dc270e88-39fa-4781-966a-36f26b64340e/konnectivity-agent/0.log" Apr 24 22:14:49.161748 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:49.161722 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-204.ec2.internal_dd54af8f80e3b05db4203800e6cae347/haproxy/0.log" Apr 24 22:14:53.131974 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:53.131937 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-6ddf9554fc-2t8s2_fdfce710-26f5-441a-9a65-4373321347f8/manager/0.log" Apr 24 22:14:54.265027 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.265001 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/alertmanager/0.log" Apr 24 22:14:54.287920 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.287868 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/config-reloader/0.log" Apr 24 22:14:54.310486 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.310461 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/kube-rbac-proxy-web/0.log" Apr 24 22:14:54.333406 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.333387 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/kube-rbac-proxy/0.log" Apr 24 22:14:54.357347 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.357322 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/kube-rbac-proxy-metric/0.log" Apr 24 22:14:54.379320 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.379297 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/prom-label-proxy/0.log" Apr 24 22:14:54.404636 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.404612 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5ec4f85-0cf9-4e1e-bb59-a97f6fcabf84/init-config-reloader/0.log" Apr 24 22:14:54.470840 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.470822 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xdcwr_3136303c-3def-4820-b28c-3092f1fb77db/kube-state-metrics/0.log" Apr 24 22:14:54.498721 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.498703 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xdcwr_3136303c-3def-4820-b28c-3092f1fb77db/kube-rbac-proxy-main/0.log" Apr 24 22:14:54.523031 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.522966 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xdcwr_3136303c-3def-4820-b28c-3092f1fb77db/kube-rbac-proxy-self/0.log" Apr 24 22:14:54.554843 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.554814 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8684c4b6bf-hpz7c_de203b20-8880-40d0-ad75-d535fd905491/metrics-server/0.log" Apr 24 22:14:54.581835 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.581808 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-45v8w_7491178b-c3f9-4208-809d-a2bb8ee65e1f/monitoring-plugin/0.log" Apr 24 22:14:54.686336 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.686310 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96br4_d8efd1be-eab8-42f7-8480-05613c349abf/node-exporter/0.log" Apr 24 22:14:54.708949 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.708922 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96br4_d8efd1be-eab8-42f7-8480-05613c349abf/kube-rbac-proxy/0.log" Apr 24 22:14:54.738566 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.738483 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96br4_d8efd1be-eab8-42f7-8480-05613c349abf/init-textfile/0.log" Apr 24 22:14:54.874684 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.874614 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-wxblx_1cf75630-71d7-404a-ad07-83f3fe8a8540/kube-rbac-proxy-main/0.log" Apr 24 22:14:54.901761 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.901734 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-wxblx_1cf75630-71d7-404a-ad07-83f3fe8a8540/kube-rbac-proxy-self/0.log" Apr 24 22:14:54.936949 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.936914 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-wxblx_1cf75630-71d7-404a-ad07-83f3fe8a8540/openshift-state-metrics/0.log" Apr 24 22:14:54.982225 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:54.982204 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/prometheus/0.log" Apr 24 22:14:55.014799 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.014779 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/config-reloader/0.log" Apr 24 22:14:55.042998 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.042979 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/thanos-sidecar/0.log" Apr 24 22:14:55.074434 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.074411 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/kube-rbac-proxy-web/0.log" Apr 24 22:14:55.099865 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.099841 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/kube-rbac-proxy/0.log" Apr 24 22:14:55.122966 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.122942 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/kube-rbac-proxy-thanos/0.log" Apr 24 22:14:55.146281 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.146218 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc12d4e1-9383-43f3-ae97-81d39acefad9/init-config-reloader/0.log" Apr 24 22:14:55.180270 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.180247 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-gnkc9_1474a03a-58fc-4835-bcfd-fa1e9f746678/prometheus-operator/0.log" Apr 24 22:14:55.203147 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.203124 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-gnkc9_1474a03a-58fc-4835-bcfd-fa1e9f746678/kube-rbac-proxy/0.log" Apr 24 22:14:55.273378 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.273355 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cf78b7565-frqnn_5a194a78-5ba5-45d9-a118-d63acc7a75a2/telemeter-client/0.log" Apr 24 22:14:55.297305 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.297283 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cf78b7565-frqnn_5a194a78-5ba5-45d9-a118-d63acc7a75a2/reload/0.log" Apr 24 22:14:55.322209 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.322191 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cf78b7565-frqnn_5a194a78-5ba5-45d9-a118-d63acc7a75a2/kube-rbac-proxy/0.log" Apr 24 22:14:55.358140 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.358120 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/thanos-query/0.log" Apr 24 22:14:55.390851 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.390830 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/kube-rbac-proxy-web/0.log" Apr 24 22:14:55.428403 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.428348 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/kube-rbac-proxy/0.log" Apr 24 22:14:55.453867 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.453845 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/prom-label-proxy/0.log" Apr 24 22:14:55.478002 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.477986 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/kube-rbac-proxy-rules/0.log" Apr 24 22:14:55.503453 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:55.503433 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dc5d49779-l4htf_450f1f68-e99a-4ee3-98cc-f522ec922f08/kube-rbac-proxy-metrics/0.log" Apr 24 22:14:57.719832 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:57.719804 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55d5cf6bcc-nr8ql_6ce781c3-f3a5-48ed-974c-eae88a54d22c/console/0.log" Apr 24 22:14:58.069459 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.069383 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx"] Apr 24 22:14:58.072878 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.072857 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.075680 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.075664 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lj9kt\"/\"openshift-service-ca.crt\"" Apr 24 22:14:58.076447 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.076428 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lj9kt\"/\"kube-root-ca.crt\"" Apr 24 22:14:58.076509 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.076428 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lj9kt\"/\"default-dockercfg-w6nqf\"" Apr 24 22:14:58.083125 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.083103 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx"] Apr 24 22:14:58.198496 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.198452 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4klz\" (UniqueName: \"kubernetes.io/projected/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-kube-api-access-m4klz\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.198496 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.198503 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-proc\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.198741 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.198540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-lib-modules\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.198741 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.198580 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-podres\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.198741 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.198629 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-sys\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299207 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299166 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-podres\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299207 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299213 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-sys\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299259 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4klz\" (UniqueName: \"kubernetes.io/projected/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-kube-api-access-m4klz\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299285 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-proc\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299300 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-lib-modules\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299331 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-podres\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-sys\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299386 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-proc\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.299420 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.299418 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-lib-modules\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.307844 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.307825 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4klz\" (UniqueName: \"kubernetes.io/projected/3f0e5947-1b7b-4cba-ba5f-7884889bcba4-kube-api-access-m4klz\") pod \"perf-node-gather-daemonset-gjpsx\" (UID: \"3f0e5947-1b7b-4cba-ba5f-7884889bcba4\") " pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.383973 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.383915 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:58.514883 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.514850 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx"] Apr 24 22:14:58.519071 ip-10-0-129-204 kubenswrapper[2571]: W0424 22:14:58.519042 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f0e5947_1b7b_4cba_ba5f_7884889bcba4.slice/crio-8e34a723432aacdc4ac71a41203e9a6fc1ed3ed6f28c921215d719547beaef48 WatchSource:0}: Error finding container 8e34a723432aacdc4ac71a41203e9a6fc1ed3ed6f28c921215d719547beaef48: Status 404 returned error can't find the container with id 8e34a723432aacdc4ac71a41203e9a6fc1ed3ed6f28c921215d719547beaef48 Apr 24 22:14:58.520784 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:58.520763 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 22:14:59.110356 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.110328 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd6ql_12b376f6-af4e-43f7-aabc-502f414235d5/dns/0.log" Apr 24 22:14:59.133956 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.133932 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qd6ql_12b376f6-af4e-43f7-aabc-502f414235d5/kube-rbac-proxy/0.log" Apr 24 22:14:59.204799 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.204772 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbbz5_8824dd66-c4e0-4bc5-86b8-8819373b88d8/dns-node-resolver/0.log" Apr 24 22:14:59.508344 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.508312 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" event={"ID":"3f0e5947-1b7b-4cba-ba5f-7884889bcba4","Type":"ContainerStarted","Data":"a42409cd740687fb8aaa56ce45032646d652ec39fc1f3195cc760ef3435b9f8c"} Apr 24 22:14:59.508344 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.508346 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" event={"ID":"3f0e5947-1b7b-4cba-ba5f-7884889bcba4","Type":"ContainerStarted","Data":"8e34a723432aacdc4ac71a41203e9a6fc1ed3ed6f28c921215d719547beaef48"} Apr 24 22:14:59.508543 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.508455 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:14:59.527298 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.527248 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" podStartSLOduration=1.527234945 podStartE2EDuration="1.527234945s" podCreationTimestamp="2026-04-24 22:14:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 22:14:59.525055709 +0000 UTC m=+2883.379815423" watchObservedRunningTime="2026-04-24 22:14:59.527234945 +0000 UTC m=+2883.381994634" Apr 24 22:14:59.722111 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:14:59.722076 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7lqt_d3cfa15a-8e10-489d-94cd-7b8da6f3b83b/node-ca/0.log" Apr 24 22:15:00.560966 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:00.560936 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-55ff986f96-n779d_6a705e5b-90b1-49e8-a8e6-c523a9e009a0/discovery/0.log" Apr 24 22:15:01.163909 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:01.163875 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2rbj_039f54e2-67cf-4236-b46b-973bc566ac65/serve-healthcheck-canary/0.log" Apr 24 22:15:01.636748 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:01.636722 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2n844_cb5e203f-2bca-4bd1-bd9f-519d859bd9ed/kube-rbac-proxy/0.log" Apr 24 22:15:01.660479 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:01.660447 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2n844_cb5e203f-2bca-4bd1-bd9f-519d859bd9ed/exporter/0.log" Apr 24 22:15:01.682905 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:01.682883 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2n844_cb5e203f-2bca-4bd1-bd9f-519d859bd9ed/extractor/0.log" Apr 24 22:15:04.340216 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:04.340188 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-798cfdf8b-58l5p_a04b4b13-34ad-46fa-bb9e-f1c66ca639c8/manager/0.log" Apr 24 22:15:04.940008 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:04.939949 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-69d55c4586-mpk9p_00042ac6-1fcf-43a7-8097-4e992c24cc1f/manager/0.log" Apr 24 22:15:05.522805 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:05.522781 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lj9kt/perf-node-gather-daemonset-gjpsx" Apr 24 22:15:11.856602 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.856559 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/kube-multus-additional-cni-plugins/0.log" Apr 24 22:15:11.881510 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.881485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/egress-router-binary-copy/0.log" Apr 24 22:15:11.906825 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.906805 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/cni-plugins/0.log" Apr 24 22:15:11.930570 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.930549 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/bond-cni-plugin/0.log" Apr 24 22:15:11.951925 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.951903 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/routeoverride-cni/0.log" Apr 24 22:15:11.975792 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.975772 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/whereabouts-cni-bincopy/0.log" Apr 24 22:15:11.999014 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:11.998990 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xglrz_45e86ed3-921a-4890-a847-d104835d5b0a/whereabouts-cni/0.log" Apr 24 22:15:12.074875 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:12.074853 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zhk5d_2e9b1768-b354-48f2-86d3-fc71a5fc0ecf/kube-multus/0.log" Apr 24 22:15:12.103064 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:12.103045 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4h277_7151d443-18e1-458e-a1d5-d2536594c786/network-metrics-daemon/0.log" Apr 24 22:15:12.125699 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:12.125630 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4h277_7151d443-18e1-458e-a1d5-d2536594c786/kube-rbac-proxy/0.log" Apr 24 22:15:13.429403 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.429367 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-controller/0.log" Apr 24 22:15:13.449279 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.449249 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/0.log" Apr 24 22:15:13.460777 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.460753 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovn-acl-logging/1.log" Apr 24 22:15:13.481437 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.481414 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/kube-rbac-proxy-node/0.log" Apr 24 22:15:13.504093 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.504067 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/kube-rbac-proxy-ovn-metrics/0.log" Apr 24 22:15:13.525520 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.525502 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/northd/0.log" Apr 24 22:15:13.550183 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.550164 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/nbdb/0.log" Apr 24 22:15:13.574671 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.574649 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/sbdb/0.log" Apr 24 22:15:13.679697 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:13.679625 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc9kf_1f753fd6-6a03-4817-9e99-29a3525dbf1e/ovnkube-controller/0.log" Apr 24 22:15:15.104899 ip-10-0-129-204 kubenswrapper[2571]: I0424 22:15:15.104875 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ztccj_8065db05-6bcb-4dbf-8e1b-d1709c4ca5e9/network-check-target-container/0.log"