Sep 11 02:44:03.102809 ip-10-0-136-112 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 11 02:44:03.102818 ip-10-0-136-112 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 11 02:44:03.102825 ip-10-0-136-112 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 11 02:44:03.103045 ip-10-0-136-112 systemd[1]: Failed to start Kubernetes Kubelet. Sep 11 02:44:13.352212 ip-10-0-136-112 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 11 02:44:13.352228 ip-10-0-136-112 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c5179ad51a6f4a96b76f323dba4b60e6 -- Sep 11 02:46:06.240689 ip-10-0-136-112 systemd[1]: Starting Kubernetes Kubelet... Sep 11 02:46:06.649712 ip-10-0-136-112 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:46:06.649712 ip-10-0-136-112 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 02:46:06.649712 ip-10-0-136-112 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:46:06.649712 ip-10-0-136-112 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 02:46:06.649712 ip-10-0-136-112 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:46:06.650369 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.649770 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 02:46:06.653394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653378 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653395 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653411 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653415 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653418 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653421 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653424 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653427 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653429 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653432 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653435 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653437 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653440 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.653437 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653444 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653448 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653453 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653456 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653459 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653462 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653465 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653468 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653470 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653473 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653476 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653478 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653481 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653484 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653486 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653489 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653491 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653494 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653496 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.653753 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653499 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653502 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653504 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653506 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653509 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653511 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653514 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653516 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653519 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653521 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653524 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653526 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653528 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653536 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653539 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653548 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653551 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653554 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653556 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.654196 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653560 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653564 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653567 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653570 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653573 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653576 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653579 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653582 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653584 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653587 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653590 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653593 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653595 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653598 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653600 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653603 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653605 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653607 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653610 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653612 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.654823 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653614 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653617 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653619 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653623 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653625 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653627 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653630 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653641 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653646 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653649 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653651 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653654 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653656 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653659 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653661 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653664 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653666 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653669 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653671 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.655307 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653675 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653679 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653682 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653684 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653687 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653689 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653692 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653695 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.653697 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654439 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654448 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654451 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654454 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654458 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654461 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654464 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654467 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654470 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654472 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654475 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.655785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654478 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654484 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654487 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654489 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654492 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654495 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654499 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654503 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654506 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654510 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654513 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654525 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654528 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654530 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654533 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654535 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654538 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654541 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654544 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.656263 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654547 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654550 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654552 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654555 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654558 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654560 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654562 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654565 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654567 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654570 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654572 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654575 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654577 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654580 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654583 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654586 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654589 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654591 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654594 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654596 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.656748 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654599 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654603 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654605 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654608 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654611 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654614 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654616 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654619 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654621 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654624 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654628 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654632 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654634 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654637 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654640 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654643 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654646 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654648 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654651 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.657265 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654654 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654656 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654659 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654661 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654663 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654666 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654668 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654671 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654674 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654677 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654680 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654682 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654685 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654687 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654690 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654692 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654696 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654699 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654701 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654704 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.657747 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654709 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654711 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654713 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654716 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654719 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654721 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654724 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654726 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654729 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.654731 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655075 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655079 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655082 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655085 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655088 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655091 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655093 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655096 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655098 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655101 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.658235 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655104 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655107 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655110 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655112 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655115 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655118 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655120 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655122 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655127 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655130 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655132 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655135 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655137 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655140 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655142 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655145 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655147 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655150 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655152 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655154 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.658735 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655157 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655159 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655162 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655164 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655167 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655169 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655171 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655174 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655176 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655178 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655181 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655184 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655187 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655189 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655194 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655198 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655200 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655203 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655206 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655209 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.659226 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655212 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655215 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655217 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655220 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655222 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655224 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655227 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655229 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655232 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655236 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655239 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655241 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655244 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655247 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655249 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655251 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655254 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655257 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655259 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.659724 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655262 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655265 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655268 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655270 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655273 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655275 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655278 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655281 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655285 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655287 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655289 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655292 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655295 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655299 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655301 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655303 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655306 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655308 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655311 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.660172 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655314 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655316 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655319 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655322 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655324 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655327 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655329 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655332 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655334 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655336 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.655339 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655422 2557 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655466 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655473 2557 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655477 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655482 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655486 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655490 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655494 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655497 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655500 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 02:46:06.660639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655504 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655508 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655511 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655514 2557 flags.go:64] FLAG: --cgroup-root="" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655517 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655520 2557 flags.go:64] FLAG: --client-ca-file="" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655523 2557 flags.go:64] FLAG: --cloud-provider="external" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655526 2557 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655531 2557 flags.go:64] FLAG: --cluster-domain="" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655534 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655537 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655540 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655543 2557 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655547 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655549 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655553 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655556 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655558 2557 flags.go:64] FLAG: --contention-profiling="false" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655561 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655564 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655567 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655570 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655574 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655577 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655579 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 02:46:06.661145 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655582 2557 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655585 2557 flags.go:64] FLAG: --enable-server="true" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655588 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655592 2557 flags.go:64] FLAG: --event-burst="100" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655595 2557 flags.go:64] FLAG: --event-qps="50" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655598 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655601 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655604 2557 flags.go:64] FLAG: --eviction-hard="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655608 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655611 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655614 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655617 2557 flags.go:64] FLAG: --eviction-soft="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655621 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655624 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655627 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655630 2557 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655632 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655635 2557 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655638 2557 flags.go:64] FLAG: --feature-gates="" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655642 2557 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655645 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655648 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655651 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655653 2557 flags.go:64] FLAG: --healthz-port="10248" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655656 2557 flags.go:64] FLAG: --help="false" Sep 11 02:46:06.661760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655659 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655662 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655665 2557 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655668 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655671 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655675 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655677 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655682 2557 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655685 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655687 2557 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655690 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655694 2557 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655696 2557 flags.go:64] FLAG: --kube-reserved="" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655699 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655702 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655705 2557 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655707 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655711 2557 flags.go:64] FLAG: --lock-file="" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655714 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655717 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655719 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655725 2557 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655727 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655730 2557 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 02:46:06.662416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655733 2557 flags.go:64] FLAG: --logging-format="text" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655736 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655739 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655741 2557 flags.go:64] FLAG: --manifest-url="" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655744 2557 flags.go:64] FLAG: --manifest-url-header="" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655748 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655751 2557 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655755 2557 flags.go:64] FLAG: --max-pods="110" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655758 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655761 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655764 2557 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655767 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655770 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655773 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655775 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655784 2557 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655787 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655790 2557 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655793 2557 flags.go:64] FLAG: --pod-cidr="" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655796 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655802 2557 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655805 2557 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655808 2557 flags.go:64] FLAG: --pods-per-core="0" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655811 2557 flags.go:64] FLAG: --port="10250" Sep 11 02:46:06.663284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655813 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655816 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09521a0beebc00d17" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655820 2557 flags.go:64] FLAG: --qos-reserved="" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655823 2557 flags.go:64] FLAG: --read-only-port="10255" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655826 2557 flags.go:64] FLAG: --register-node="true" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655829 2557 flags.go:64] FLAG: --register-with-taints="" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655833 2557 flags.go:64] FLAG: --registry-burst="10" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655836 2557 flags.go:64] FLAG: --registry-qps="5" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655839 2557 flags.go:64] FLAG: --reserved-cpus="" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655842 2557 flags.go:64] FLAG: --reserved-memory="" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655845 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655849 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655851 2557 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655854 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655857 2557 flags.go:64] FLAG: --runonce="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655860 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655863 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655866 2557 flags.go:64] FLAG: --seccomp-default="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655869 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655872 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655875 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655878 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655881 2557 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655884 2557 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655888 2557 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 02:46:06.664054 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655891 2557 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655894 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655898 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655901 2557 flags.go:64] FLAG: --system-cgroups="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655903 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655908 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655911 2557 flags.go:64] FLAG: --tls-cert-file="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655914 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655919 2557 flags.go:64] FLAG: --tls-min-version="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655921 2557 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655925 2557 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655928 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655931 2557 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655934 2557 flags.go:64] FLAG: --v="2" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655937 2557 flags.go:64] FLAG: --version="false" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655941 2557 flags.go:64] FLAG: --vmodule="" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655945 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.655948 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656059 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656063 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656066 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656070 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656074 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.664844 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656077 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656080 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656083 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656085 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656088 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656090 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656093 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656095 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656100 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656102 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656105 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656109 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656112 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656114 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656117 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656119 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656122 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656124 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656127 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.665427 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656130 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656133 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656135 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656138 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656140 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656143 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656145 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656148 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656150 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656153 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656155 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656158 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656160 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656163 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656165 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656168 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656170 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656173 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656175 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.665902 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656179 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656183 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656187 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656189 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656192 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656196 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656198 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656201 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656204 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656206 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656209 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656211 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656214 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656216 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656219 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656222 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656225 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656227 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656229 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656232 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.666378 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656235 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656237 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656239 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656242 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656244 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656247 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656249 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656252 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656254 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656257 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656259 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656262 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656264 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656267 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656270 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656275 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656278 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656283 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656286 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656289 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.666891 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656292 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656294 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656297 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656299 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656302 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656304 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656307 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656309 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656312 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656315 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656317 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656320 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656322 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656325 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656328 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.667365 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.656330 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.656338 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.665159 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.665175 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.666206 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.666214 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666270 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666274 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666278 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666281 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666284 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666287 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666290 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666292 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.667758 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666295 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666298 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666300 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666303 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666305 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666309 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666313 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666316 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666319 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666322 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666324 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666327 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666330 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666333 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666335 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666338 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666341 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666344 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666348 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.668108 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666351 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666354 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666357 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666360 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666363 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666366 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666369 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666371 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666374 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666377 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666379 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666383 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666385 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666388 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666391 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666394 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666411 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666416 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666418 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666421 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.668590 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666425 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666427 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666430 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666432 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666435 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666437 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666440 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666442 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666445 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666447 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666450 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666452 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666455 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666458 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666461 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666464 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666467 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666470 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666473 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.669070 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666475 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666478 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666480 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666482 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666485 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666487 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666490 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666492 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666495 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666497 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666500 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666505 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666507 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666511 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666514 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666523 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666526 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666529 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666531 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.669551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666534 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666536 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666539 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666542 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666544 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666547 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666550 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666552 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666555 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666558 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666560 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666563 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666566 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666569 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.666574 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:46:06.670031 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666680 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666685 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666688 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666691 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666694 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666696 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666699 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666702 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666704 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666706 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666709 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666711 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666714 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666717 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666720 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666722 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666725 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666727 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666730 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666732 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:46:06.670394 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666735 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666737 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666740 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666742 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666744 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666747 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666749 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666752 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666754 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666757 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666760 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666762 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666765 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666767 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666770 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666773 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666775 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666778 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666782 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666785 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:46:06.670914 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666787 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666789 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666792 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666794 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666796 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666800 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666803 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666805 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666807 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666810 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666813 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666815 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666818 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666821 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666824 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666827 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666830 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666833 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:46:06.671439 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666837 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666840 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666843 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666846 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666849 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666851 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666854 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666857 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666860 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666862 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666865 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666867 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666870 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666872 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666874 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666877 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666879 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666882 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666884 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666886 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:46:06.671906 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666890 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666893 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666895 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666898 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666901 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666903 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666906 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666908 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666911 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666913 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666916 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666918 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666921 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666923 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666925 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666928 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666930 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666933 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666935 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666938 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:46:06.672376 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:06.666941 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.666945 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.667051 2557 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.669598 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.670471 2557 server.go:1019] "Starting client certificate rotation" Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.670575 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:46:06.672963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.670616 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:46:06.673144 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.673059 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:46:06.674212 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.674194 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:46:06.687146 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.687126 2557 log.go:25] "Validated CRI v1 runtime API" Sep 11 02:46:06.689962 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.689941 2557 log.go:25] "Validated CRI v1 image API" Sep 11 02:46:06.690773 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.690761 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 02:46:06.693844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.693821 2557 fs.go:135] Filesystem UUIDs: map[43b316c3-a2ab-4d6f-a154-f069f7052000:/dev/nvme0n1p3 4f21ecf9-01fb-43b7-977f-5bab4975947e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 11 02:46:06.693894 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.693845 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 02:46:06.699535 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.699513 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:46:06.701186 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.701064 2557 manager.go:216] Machine: {Timestamp:2026-09-11 02:46:06.699522205 +0000 UTC m=+0.341856525 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097686 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2becc885c2cc09656e355d96e9a1f1 SystemUUID:ec2becc8-85c2-cc09-656e-355d96e9a1f1 BootID:c5179ad5-1a6f-4a96-b76f-323dba4b60e6 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:55:ce:e6:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:55:ce:e6:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:79:7a:59:1c:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 02:46:06.701186 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.701179 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 02:46:06.701348 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.701297 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 02:46:06.703973 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.703945 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 02:46:06.704142 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.703975 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 02:46:06.704728 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.704716 2557 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 02:46:06.704794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.704734 2557 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 02:46:06.704794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.704745 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:46:06.705547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.705536 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:46:06.707008 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.706996 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 02:46:06.710098 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710083 2557 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:46:06.710233 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710222 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 02:46:06.710299 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710260 2557 kubelet.go:486] "Attempting to sync node with API server" Sep 11 02:46:06.710299 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710274 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 02:46:06.710299 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710294 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 02:46:06.710439 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710308 2557 kubelet.go:398] "Adding apiserver pod source" Sep 11 02:46:06.710439 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710320 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 02:46:06.710739 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710725 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:46:06.710808 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.710749 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:46:06.712959 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.712940 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 02:46:06.715525 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.715512 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 02:46:06.715578 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.715542 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 02:46:06.717518 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717496 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 02:46:06.717518 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717516 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 02:46:06.717518 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717521 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717527 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717536 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717541 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717554 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717559 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717566 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717572 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717580 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 02:46:06.717654 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.717586 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 02:46:06.718434 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.718391 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 02:46:06.718479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.718440 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 02:46:06.719269 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.719249 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 02:46:06.719341 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.719249 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 02:46:06.719745 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.719729 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdwkh" Sep 11 02:46:06.722315 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.722301 2557 server.go:1268] "Started kubelet" Sep 11 02:46:06.722419 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.722369 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 02:46:06.722457 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.722391 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 02:46:06.722527 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.722506 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 02:46:06.723364 ip-10-0-136-112 systemd[1]: Started Kubernetes Kubelet. Sep 11 02:46:06.724423 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.724358 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 02:46:06.724874 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.724850 2557 server.go:310] "Adding debug handlers to kubelet server" Sep 11 02:46:06.726751 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.726732 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdwkh" Sep 11 02:46:06.727666 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.727642 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 02:46:06.728352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.728334 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 02:46:06.729205 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.728344 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-112.ec2.internal.18d4243617fdcfb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-112.ec2.internal,UID:ip-10-0-136-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-112.ec2.internal,},FirstTimestamp:2026-09-11 02:46:06.722273205 +0000 UTC m=+0.364607525,LastTimestamp:2026-09-11 02:46:06.722273205 +0000 UTC m=+0.364607525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-112.ec2.internal,}" Sep 11 02:46:06.730837 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.730821 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 02:46:06.731331 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731317 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 02:46:06.731505 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.731450 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:06.731951 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731871 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 02:46:06.731951 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731888 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 02:46:06.731951 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731871 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 02:46:06.732138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731966 2557 reconstruct.go:97] "Volume reconstruction finished" Sep 11 02:46:06.732138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.731974 2557 reconciler.go:29] "Reconciler: start to sync state" Sep 11 02:46:06.732549 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732533 2557 factory.go:55] Registering systemd factory Sep 11 02:46:06.732633 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732551 2557 factory.go:223] Registration of the systemd container factory successfully Sep 11 02:46:06.732741 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732730 2557 factory.go:153] Registering CRI-O factory Sep 11 02:46:06.732779 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732746 2557 factory.go:223] Registration of the crio container factory successfully Sep 11 02:46:06.732816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732806 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 02:46:06.732850 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732829 2557 factory.go:103] Registering Raw factory Sep 11 02:46:06.732850 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.732844 2557 manager.go:1196] Started watching for new ooms in manager Sep 11 02:46:06.733258 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.733246 2557 manager.go:349] Starting recovery of all containers Sep 11 02:46:06.738931 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.737521 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:06.738931 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.738769 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-112.ec2.internal\" not found" node="ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.745007 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.744864 2557 manager.go:354] Recovery completed Sep 11 02:46:06.746368 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.746343 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 11 02:46:06.749243 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.749231 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.750845 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.750831 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.750907 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.750860 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.750907 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.750871 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.751425 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.751413 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 02:46:06.751471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.751425 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 02:46:06.751471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.751444 2557 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:46:06.751471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.751445 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.752149 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752135 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.752211 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752165 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.752211 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752178 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.752723 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752713 2557 policy_none.go:49] "None policy: Start" Sep 11 02:46:06.752763 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752727 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 02:46:06.752763 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.752746 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 02:46:06.753870 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.753857 2557 policy_none.go:47] "Start" Sep 11 02:46:06.801936 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.801921 2557 manager.go:337] "Starting Device Plugin manager" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.801957 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.801967 2557 server.go:87] "Starting device plugin registration server" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.802378 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.802391 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.802512 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.802618 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.802628 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.803095 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 02:46:06.804712 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.803135 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:06.833709 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.833677 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 02:46:06.834993 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.834976 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 02:46:06.835083 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.835025 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 02:46:06.835083 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.835058 2557 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 02:46:06.835432 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.835137 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 02:46:06.837242 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.837224 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:06.903146 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.903044 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.903963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.903947 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.904056 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.903980 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.904056 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.903993 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.904056 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.904022 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.911895 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.911880 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.911954 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.911901 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-112.ec2.internal\": node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:06.926592 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.926569 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:06.935195 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.935180 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal"] Sep 11 02:46:06.935260 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.935249 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.936674 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.936659 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.936758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.936691 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.936758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.936705 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.938115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938084 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.938204 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938191 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.938250 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938224 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.938782 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938768 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.938852 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938791 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.938852 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.938806 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.940102 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.940085 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.940185 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.940107 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.940185 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.940117 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.941537 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.941521 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.941601 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.941554 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:46:06.942235 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.942218 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:46:06.942309 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.942249 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:46:06.942309 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:06.942264 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:46:06.970995 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.970975 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-112.ec2.internal\" not found" node="ip-10-0-136-112.ec2.internal" Sep 11 02:46:06.975185 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:06.975161 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-112.ec2.internal\" not found" node="ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.027539 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.027520 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.127984 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.127944 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.133258 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.133237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.133306 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.133267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.133306 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.133286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02c674f7b3e783f8387eda67eea537c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-112.ec2.internal\" (UID: \"02c674f7b3e783f8387eda67eea537c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.228718 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.228634 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.233964 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.233950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.234018 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.233972 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.234018 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.233998 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02c674f7b3e783f8387eda67eea537c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-112.ec2.internal\" (UID: \"02c674f7b3e783f8387eda67eea537c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.234079 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.234026 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02c674f7b3e783f8387eda67eea537c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-112.ec2.internal\" (UID: \"02c674f7b3e783f8387eda67eea537c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.234079 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.234059 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.234079 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.234066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ec539ca26d2e4159a969e91ec7af7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal\" (UID: \"b6ec539ca26d2e4159a969e91ec7af7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.273100 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.273075 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.278280 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.278264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:07.329110 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.329080 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.429544 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.429518 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.530149 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.530072 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.630581 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.630551 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.669934 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.669912 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 02:46:07.670337 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.670071 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:46:07.670337 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.670071 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:46:07.731088 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.731060 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.731088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.731059 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 02:41:07 +0000 UTC" deadline="2028-04-22 06:35:38.434335784 +0000 UTC" Sep 11 02:46:07.731088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.731094 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14139h49m30.703245105s" Sep 11 02:46:07.832142 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.832064 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:07.899299 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:07.899260 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ec539ca26d2e4159a969e91ec7af7f.slice/crio-0fd3419f58e5efedb54826df5e374e8e30543a7f6e892f65007aa33d240cb9b7 WatchSource:0}: Error finding container 0fd3419f58e5efedb54826df5e374e8e30543a7f6e892f65007aa33d240cb9b7: Status 404 returned error can't find the container with id 0fd3419f58e5efedb54826df5e374e8e30543a7f6e892f65007aa33d240cb9b7 Sep 11 02:46:07.899713 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:07.899691 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c674f7b3e783f8387eda67eea537c8.slice/crio-2fd311c0785e55af7b24efb6d7d1080ce750d68c53820b2e2262eb4df5383d90 WatchSource:0}: Error finding container 2fd311c0785e55af7b24efb6d7d1080ce750d68c53820b2e2262eb4df5383d90: Status 404 returned error can't find the container with id 2fd311c0785e55af7b24efb6d7d1080ce750d68c53820b2e2262eb4df5383d90 Sep 11 02:46:07.904470 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:07.904455 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:46:07.933083 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:07.933060 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:08.033489 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.033466 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:08.134276 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.134253 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-112.ec2.internal\" not found" Sep 11 02:46:08.211014 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.210993 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:08.232164 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.232137 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" Sep 11 02:46:08.245111 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.245091 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:46:08.247149 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.247136 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" Sep 11 02:46:08.255407 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.255389 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:46:08.294307 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.294285 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:08.711993 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.711961 2557 apiserver.go:52] "Watching apiserver" Sep 11 02:46:08.730526 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.730492 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 02:46:08.730994 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.730968 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4pjvl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h","openshift-dns/node-resolver-j95rw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal","openshift-multus/multus-additional-cni-plugins-24b84","openshift-multus/multus-gdzkq","openshift-network-operator/iptables-alerter-cqx7h","kube-system/konnectivity-agent-pl8hn","kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s2sfr","openshift-image-registry/node-ca-dlj9c","openshift-multus/network-metrics-daemon-wqxx6","openshift-network-diagnostics/network-check-target-g8p6h","openshift-ovn-kubernetes/ovnkube-node-mp5jm"] Sep 11 02:46:08.731107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.731085 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 02:46:08.733759 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.733730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.735225 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.735193 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:08.735331 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.735268 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:08.736818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.736781 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.736818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.736789 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.737010 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.736789 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7dfpq\"" Sep 11 02:46:08.738786 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.738434 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.739803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.739784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.741091 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.741072 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.741609 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.741586 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.741701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.741616 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rth9s\"" Sep 11 02:46:08.741852 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.741830 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.742789 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.742723 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-tmp\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-systemd\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-run\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-sys\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743230 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-host\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743255 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysconfig\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-conf\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-lib-modules\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-var-lib-kubelet\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743403 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvf7w\" (UniqueName: \"kubernetes.io/projected/08342c09-b4ce-4829-a634-880bce6c329f-kube-api-access-gvf7w\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 02:46:08.743679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743466 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743721 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743743 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-545n4\"" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743431 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-modprobe-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743931 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-etc-tuned\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-kubernetes\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743967 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.744176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.743984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745206 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745285 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745349 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745375 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7ln6w\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745463 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745602 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.746499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.745667 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:46:08.747378 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.746963 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 02:46:08.747378 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.747085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.748922 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.748844 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.749585 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.749558 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzjhz\"" Sep 11 02:46:08.749689 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.749604 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 02:46:08.750538 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.750513 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.751414 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.751397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 02:46:08.751525 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.751423 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-44wlv\"" Sep 11 02:46:08.751525 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.751398 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 02:46:08.751939 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.751923 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.752924 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.752726 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.755999 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.753798 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.755999 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.754143 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 02:46:08.755999 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.755441 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8dmqz\"" Sep 11 02:46:08.755999 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.755550 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wt8g2\"" Sep 11 02:46:08.755999 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.755443 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 02:46:08.756216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.756191 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.756295 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.756237 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.756371 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.756319 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:08.757729 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.757708 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.758605 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.758575 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.759315 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.759274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.759402 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.759371 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:08.760566 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.760545 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 02:46:08.760647 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.760587 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 02:46:08.760732 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.760714 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j9szd\"" Sep 11 02:46:08.760828 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.760545 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 02:46:08.769975 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.769953 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6hnww" Sep 11 02:46:08.776381 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.776044 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6hnww" Sep 11 02:46:08.833433 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.833413 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 02:46:08.840342 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.840291 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" event={"ID":"02c674f7b3e783f8387eda67eea537c8","Type":"ContainerStarted","Data":"2fd311c0785e55af7b24efb6d7d1080ce750d68c53820b2e2262eb4df5383d90"} Sep 11 02:46:08.841781 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.841758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" event={"ID":"b6ec539ca26d2e4159a969e91ec7af7f","Type":"ContainerStarted","Data":"0fd3419f58e5efedb54826df5e374e8e30543a7f6e892f65007aa33d240cb9b7"} Sep 11 02:46:08.844546 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-sys\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.844660 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6315050-4115-4755-9469-884121d46ebd-hosts-file\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.844660 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-var-lib-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844682 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-multus\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-sys-fs\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-sys\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844731 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-systemd-units\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.844777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-kubelet\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844848 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-netd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-k8s-cni-cncf-io\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-config\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovn-node-metrics-cert\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-tmp\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.845005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.844971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-agent-certs\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69eb83ca-8e97-4f03-9b08-1ac110899c25-serviceca\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845067 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5848ccb9-517b-4f12-95b1-02a4d871129f-iptables-alerter-script\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-systemd\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-run\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845233 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-kubelet-config\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-dbus\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.845290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-etc-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-netns\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-hostroot\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845359 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-daemon-config\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-multus-certs\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845394 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmnb\" (UniqueName: \"kubernetes.io/projected/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-kube-api-access-4lmnb\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845409 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cni-binary-copy\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6315050-4115-4755-9469-884121d46ebd-tmp-dir\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whl7h\" (UniqueName: \"kubernetes.io/projected/f6315050-4115-4755-9469-884121d46ebd-kube-api-access-whl7h\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-bin\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845549 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-system-cni-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845615 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-systemd\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845625 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqhw\" (UniqueName: \"kubernetes.io/projected/af59951d-ddb6-4978-941a-000bc10b07ed-kube-api-access-xvqhw\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845675 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-run\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5848ccb9-517b-4f12-95b1-02a4d871129f-host-slash\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.845727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-device-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-kubelet\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysconfig\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-lib-modules\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvf7w\" (UniqueName: \"kubernetes.io/projected/08342c09-b4ce-4829-a634-880bce6c329f-kube-api-access-gvf7w\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845875 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysconfig\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845903 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-slash\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qmnb\" (UniqueName: \"kubernetes.io/projected/8fb58ba3-6b9c-449d-9699-c49e0492f065-kube-api-access-2qmnb\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845964 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-bin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845993 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phw8q\" (UniqueName: \"kubernetes.io/projected/5848ccb9-517b-4f12-95b1-02a4d871129f-kube-api-access-phw8q\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.845996 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-lib-modules\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-etc-tuned\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sff9m\" (UniqueName: \"kubernetes.io/projected/14e7e23f-0ed3-42f2-9e33-a334091ea350-kube-api-access-sff9m\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-ovn\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846094 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cnibin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-socket-dir-parent\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.846404 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846140 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-kubernetes\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-socket-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-log-socket\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846249 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-conf-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-host\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-registration-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-cnibin\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-conf\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-var-lib-kubelet\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846459 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjkl\" (UniqueName: \"kubernetes.io/projected/69eb83ca-8e97-4f03-9b08-1ac110899c25-kube-api-access-wdjkl\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-system-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846503 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-etc-kubernetes\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-modprobe-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69eb83ca-8e97-4f03-9b08-1ac110899c25-host\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.847107 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846599 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-kubernetes\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846657 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-host\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpx4j\" (UniqueName: \"kubernetes.io/projected/30405c0e-1372-4d3c-9d73-6e09e0d31b36-kube-api-access-rpx4j\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-netns\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846761 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-modprobe-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846812 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846830 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-konnectivity-ca\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-systemd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846937 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-d\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-node-log\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.846989 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-var-lib-kubelet\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.847002 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-env-overrides\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.847022 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08342c09-b4ce-4829-a634-880bce6c329f-etc-sysctl-conf\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.847030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-script-lib\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.847863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.847124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.849878 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.849855 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-etc-tuned\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.849997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.849941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08342c09-b4ce-4829-a634-880bce6c329f-tmp\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.854396 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.854378 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvf7w\" (UniqueName: \"kubernetes.io/projected/08342c09-b4ce-4829-a634-880bce6c329f-kube-api-access-gvf7w\") pod \"tuned-s2sfr\" (UID: \"08342c09-b4ce-4829-a634-880bce6c329f\") " pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:08.947691 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-registration-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-cnibin\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjkl\" (UniqueName: \"kubernetes.io/projected/69eb83ca-8e97-4f03-9b08-1ac110899c25-kube-api-access-wdjkl\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-cnibin\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-registration-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947816 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-system-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947859 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947875 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-system-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-etc-kubernetes\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.947884 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-cni-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69eb83ca-8e97-4f03-9b08-1ac110899c25-host\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947923 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-etc-kubernetes\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947943 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx4j\" (UniqueName: \"kubernetes.io/projected/30405c0e-1372-4d3c-9d73-6e09e0d31b36-kube-api-access-rpx4j\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947969 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69eb83ca-8e97-4f03-9b08-1ac110899c25-host\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.947970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-netns\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948004 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-netns\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-konnectivity-ca\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-systemd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948108 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-node-log\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948158 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-env-overrides\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-script-lib\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948209 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6315050-4115-4755-9469-884121d46ebd-hosts-file\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948260 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-node-log\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.948479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-var-lib-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948303 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-var-lib-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-multus\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-sys-fs\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-systemd-units\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-kubelet\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-netd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-k8s-cni-cncf-io\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-config\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948601 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovn-node-metrics-cert\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948603 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-agent-certs\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69eb83ca-8e97-4f03-9b08-1ac110899c25-serviceca\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.949352 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-konnectivity-ca\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5848ccb9-517b-4f12-95b1-02a4d871129f-iptables-alerter-script\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-kubelet-config\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948783 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-dbus\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948810 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-etc-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-netns\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948884 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-hostroot\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948893 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948909 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-daemon-config\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948917 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-script-lib\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-multus-certs\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmnb\" (UniqueName: \"kubernetes.io/projected/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-kube-api-access-4lmnb\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948969 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6315050-4115-4755-9469-884121d46ebd-hosts-file\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.948991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cni-binary-copy\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6315050-4115-4755-9469-884121d46ebd-tmp-dir\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whl7h\" (UniqueName: \"kubernetes.io/projected/f6315050-4115-4755-9469-884121d46ebd-kube-api-access-whl7h\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.950200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-bin\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-systemd-units\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949081 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-kubelet-config\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949079 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-bin\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949110 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-systemd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949128 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ce6e9ac-6d30-4ab2-8352-fa437f399915-dbus\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949145 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5848ccb9-517b-4f12-95b1-02a4d871129f-iptables-alerter-script\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949157 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949162 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-etc-openvswitch\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949204 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-netns\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949244 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949287 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-multus\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949338 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-env-overrides\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949410 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-sys-fs\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-system-cni-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-multus-certs\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949605 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.951138 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.949683 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.949764 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:09.449724409 +0000 UTC m=+3.092058738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949889 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-daemon-config\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.949936 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cni-binary-copy\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-system-cni-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-kubelet\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950321 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69eb83ca-8e97-4f03-9b08-1ac110899c25-serviceca\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.950401 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.950454 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:09.450433687 +0000 UTC m=+3.092767997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950516 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-hostroot\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-run-k8s-cni-cncf-io\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950593 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-cni-netd\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6315050-4115-4755-9469-884121d46ebd-tmp-dir\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.950934 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqhw\" (UniqueName: \"kubernetes.io/projected/af59951d-ddb6-4978-941a-000bc10b07ed-kube-api-access-xvqhw\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.952031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951051 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5848ccb9-517b-4f12-95b1-02a4d871129f-host-slash\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951051 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovnkube-config\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951155 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-device-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5848ccb9-517b-4f12-95b1-02a4d871129f-host-slash\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-kubelet\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951281 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-kubelet\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951293 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-device-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-slash\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951369 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-host-slash\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qmnb\" (UniqueName: \"kubernetes.io/projected/8fb58ba3-6b9c-449d-9699-c49e0492f065-kube-api-access-2qmnb\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-bin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phw8q\" (UniqueName: \"kubernetes.io/projected/5848ccb9-517b-4f12-95b1-02a4d871129f-kube-api-access-phw8q\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sff9m\" (UniqueName: \"kubernetes.io/projected/14e7e23f-0ed3-42f2-9e33-a334091ea350-kube-api-access-sff9m\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951506 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-host-var-lib-cni-bin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-ovn\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cnibin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-socket-dir-parent\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.952787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-socket-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-log-socket\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951672 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-conf-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951678 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-cnibin\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951702 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-run-ovn\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951749 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-conf-dir\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951768 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-multus-socket-dir-parent\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951895 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14e7e23f-0ed3-42f2-9e33-a334091ea350-socket-dir\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951902 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af59951d-ddb6-4978-941a-000bc10b07ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.951911 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8fb58ba3-6b9c-449d-9699-c49e0492f065-log-socket\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.952014 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8fb58ba3-6b9c-449d-9699-c49e0492f065-ovn-node-metrics-cert\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.952309 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af59951d-ddb6-4978-941a-000bc10b07ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.953365 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.952355 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8498562-4d72-46f3-a8db-5e6b7b9a51e4-agent-certs\") pod \"konnectivity-agent-pl8hn\" (UID: \"b8498562-4d72-46f3-a8db-5e6b7b9a51e4\") " pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:08.956792 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.956762 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpx4j\" (UniqueName: \"kubernetes.io/projected/30405c0e-1372-4d3c-9d73-6e09e0d31b36-kube-api-access-rpx4j\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:08.956792 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.956787 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:08.957028 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.956812 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:08.957028 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.956827 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:08.957028 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:08.956898 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:09.456881154 +0000 UTC m=+3.099215465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:08.957201 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.957028 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjkl\" (UniqueName: \"kubernetes.io/projected/69eb83ca-8e97-4f03-9b08-1ac110899c25-kube-api-access-wdjkl\") pod \"node-ca-dlj9c\" (UID: \"69eb83ca-8e97-4f03-9b08-1ac110899c25\") " pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:08.958972 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.958939 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmnb\" (UniqueName: \"kubernetes.io/projected/bbfda7b3-e2e7-4f82-a45d-beba8696a4dd-kube-api-access-4lmnb\") pod \"multus-gdzkq\" (UID: \"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd\") " pod="openshift-multus/multus-gdzkq" Sep 11 02:46:08.959262 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.959239 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whl7h\" (UniqueName: \"kubernetes.io/projected/f6315050-4115-4755-9469-884121d46ebd-kube-api-access-whl7h\") pod \"node-resolver-j95rw\" (UID: \"f6315050-4115-4755-9469-884121d46ebd\") " pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:08.959909 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.959880 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqhw\" (UniqueName: \"kubernetes.io/projected/af59951d-ddb6-4978-941a-000bc10b07ed-kube-api-access-xvqhw\") pod \"multus-additional-cni-plugins-24b84\" (UID: \"af59951d-ddb6-4978-941a-000bc10b07ed\") " pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:08.961144 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.961117 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phw8q\" (UniqueName: \"kubernetes.io/projected/5848ccb9-517b-4f12-95b1-02a4d871129f-kube-api-access-phw8q\") pod \"iptables-alerter-cqx7h\" (UID: \"5848ccb9-517b-4f12-95b1-02a4d871129f\") " pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:08.961845 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.961825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qmnb\" (UniqueName: \"kubernetes.io/projected/8fb58ba3-6b9c-449d-9699-c49e0492f065-kube-api-access-2qmnb\") pod \"ovnkube-node-mp5jm\" (UID: \"8fb58ba3-6b9c-449d-9699-c49e0492f065\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:08.963066 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:08.963018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sff9m\" (UniqueName: \"kubernetes.io/projected/14e7e23f-0ed3-42f2-9e33-a334091ea350-kube-api-access-sff9m\") pod \"aws-ebs-csi-driver-node-9x68h\" (UID: \"14e7e23f-0ed3-42f2-9e33-a334091ea350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:09.025690 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.025662 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:09.049138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.049114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" Sep 11 02:46:09.061785 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.061765 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j95rw" Sep 11 02:46:09.070672 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.070654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:09.078366 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.078341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24b84" Sep 11 02:46:09.087439 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.087369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdzkq" Sep 11 02:46:09.096446 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.096425 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:09.105230 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.105209 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqx7h" Sep 11 02:46:09.114036 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.114015 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" Sep 11 02:46:09.120886 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.120854 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dlj9c" Sep 11 02:46:09.240985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.240909 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:46:09.455711 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.455671 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:09.455711 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.455721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:09.455954 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.455859 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:09.455954 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.455860 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:09.455954 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.455927 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:10.455906158 +0000 UTC m=+4.098240485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:09.455954 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.455946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:10.455935987 +0000 UTC m=+4.098270299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:09.556627 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.556539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:09.556781 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.556705 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:09.556781 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.556725 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:09.556781 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.556738 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:09.556912 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:09.556806 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:10.556785304 +0000 UTC m=+4.199119628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:09.778361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.778321 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:41:09 +0000 UTC" deadline="2028-06-12 02:40:49.112931024 +0000 UTC" Sep 11 02:46:09.778361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:09.778352 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15359h54m39.334582555s" Sep 11 02:46:10.059023 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.058569 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e7e23f_0ed3_42f2_9e33_a334091ea350.slice/crio-da28567bb654ec8dedc96e8d436898d3a7a3e4249ab27d1ab0ed76dcacd5867c WatchSource:0}: Error finding container da28567bb654ec8dedc96e8d436898d3a7a3e4249ab27d1ab0ed76dcacd5867c: Status 404 returned error can't find the container with id da28567bb654ec8dedc96e8d436898d3a7a3e4249ab27d1ab0ed76dcacd5867c Sep 11 02:46:10.060189 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.060161 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5848ccb9_517b_4f12_95b1_02a4d871129f.slice/crio-147ded9f76f371fcc14910f550f2ed6cdef6294470aa8853166777f2542ecbe6 WatchSource:0}: Error finding container 147ded9f76f371fcc14910f550f2ed6cdef6294470aa8853166777f2542ecbe6: Status 404 returned error can't find the container with id 147ded9f76f371fcc14910f550f2ed6cdef6294470aa8853166777f2542ecbe6 Sep 11 02:46:10.061857 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.061013 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb58ba3_6b9c_449d_9699_c49e0492f065.slice/crio-c920eb84c85a399dca43682298f45a87b160c803b2beabbe18e7b1bdb65b92a7 WatchSource:0}: Error finding container c920eb84c85a399dca43682298f45a87b160c803b2beabbe18e7b1bdb65b92a7: Status 404 returned error can't find the container with id c920eb84c85a399dca43682298f45a87b160c803b2beabbe18e7b1bdb65b92a7 Sep 11 02:46:10.065474 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.065449 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbfda7b3_e2e7_4f82_a45d_beba8696a4dd.slice/crio-5cbf8c1209ea8a991f23b446668787a888ac9cc919862ec493a58085bf1b405e WatchSource:0}: Error finding container 5cbf8c1209ea8a991f23b446668787a888ac9cc919862ec493a58085bf1b405e: Status 404 returned error can't find the container with id 5cbf8c1209ea8a991f23b446668787a888ac9cc919862ec493a58085bf1b405e Sep 11 02:46:10.066053 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.066029 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8498562_4d72_46f3_a8db_5e6b7b9a51e4.slice/crio-2dcc1c8bb7b963a93b4d06493ba8f567936654c8696c519dee291e85f24ff41a WatchSource:0}: Error finding container 2dcc1c8bb7b963a93b4d06493ba8f567936654c8696c519dee291e85f24ff41a: Status 404 returned error can't find the container with id 2dcc1c8bb7b963a93b4d06493ba8f567936654c8696c519dee291e85f24ff41a Sep 11 02:46:10.067061 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.066953 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08342c09_b4ce_4829_a634_880bce6c329f.slice/crio-5b1da2e97876e492a312ec5d34956ff57f1b25fc92ee77e0bf229a6d9023d483 WatchSource:0}: Error finding container 5b1da2e97876e492a312ec5d34956ff57f1b25fc92ee77e0bf229a6d9023d483: Status 404 returned error can't find the container with id 5b1da2e97876e492a312ec5d34956ff57f1b25fc92ee77e0bf229a6d9023d483 Sep 11 02:46:10.069778 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.069746 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf59951d_ddb6_4978_941a_000bc10b07ed.slice/crio-ed95254247bc041940033475573899c2e530c97c432ffc3866b7264a091169f7 WatchSource:0}: Error finding container ed95254247bc041940033475573899c2e530c97c432ffc3866b7264a091169f7: Status 404 returned error can't find the container with id ed95254247bc041940033475573899c2e530c97c432ffc3866b7264a091169f7 Sep 11 02:46:10.072053 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.071148 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69eb83ca_8e97_4f03_9b08_1ac110899c25.slice/crio-4793687f4a9ccef0aa0e61f6c7a3ef101c40c5f6cef68c7ee5ed3cdd213a12a0 WatchSource:0}: Error finding container 4793687f4a9ccef0aa0e61f6c7a3ef101c40c5f6cef68c7ee5ed3cdd213a12a0: Status 404 returned error can't find the container with id 4793687f4a9ccef0aa0e61f6c7a3ef101c40c5f6cef68c7ee5ed3cdd213a12a0 Sep 11 02:46:10.072641 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:10.072605 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6315050_4115_4755_9469_884121d46ebd.slice/crio-ead930f7911840f451b191615a31dfd0a4c2ded2dfd88e3dcdb72ff9b5b80312 WatchSource:0}: Error finding container ead930f7911840f451b191615a31dfd0a4c2ded2dfd88e3dcdb72ff9b5b80312: Status 404 returned error can't find the container with id ead930f7911840f451b191615a31dfd0a4c2ded2dfd88e3dcdb72ff9b5b80312 Sep 11 02:46:10.462890 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.462859 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:10.463013 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.462899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:10.463013 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.462989 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:10.463097 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.463011 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:10.463097 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.463041 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:12.463025976 +0000 UTC m=+6.105360284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:10.463097 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.463065 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:12.463051593 +0000 UTC m=+6.105385915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:10.564126 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.564036 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:10.564303 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.564280 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:10.564303 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.564302 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:10.564424 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.564315 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:10.564424 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.564378 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:12.564357956 +0000 UTC m=+6.206692268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:10.779193 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.778892 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:41:09 +0000 UTC" deadline="2028-04-20 12:49:03.861156956 +0000 UTC" Sep 11 02:46:10.779193 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.778958 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14098h2m53.082203355s" Sep 11 02:46:10.836702 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.836607 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:10.836873 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.836783 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:10.837244 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.837219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:10.837355 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.837332 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:10.839484 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.839454 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:10.839703 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:10.839680 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:10.866653 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.866605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" event={"ID":"02c674f7b3e783f8387eda67eea537c8","Type":"ContainerStarted","Data":"deb00dab376c218b63e63078313f1096e4a493cee920f288dec58b442a13b9ce"} Sep 11 02:46:10.875618 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.875581 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j95rw" event={"ID":"f6315050-4115-4755-9469-884121d46ebd","Type":"ContainerStarted","Data":"ead930f7911840f451b191615a31dfd0a4c2ded2dfd88e3dcdb72ff9b5b80312"} Sep 11 02:46:10.884729 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.884696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerStarted","Data":"ed95254247bc041940033475573899c2e530c97c432ffc3866b7264a091169f7"} Sep 11 02:46:10.904110 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.904064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dlj9c" event={"ID":"69eb83ca-8e97-4f03-9b08-1ac110899c25","Type":"ContainerStarted","Data":"4793687f4a9ccef0aa0e61f6c7a3ef101c40c5f6cef68c7ee5ed3cdd213a12a0"} Sep 11 02:46:10.917714 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.917641 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" event={"ID":"08342c09-b4ce-4829-a634-880bce6c329f","Type":"ContainerStarted","Data":"5b1da2e97876e492a312ec5d34956ff57f1b25fc92ee77e0bf229a6d9023d483"} Sep 11 02:46:10.921875 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.921847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pl8hn" event={"ID":"b8498562-4d72-46f3-a8db-5e6b7b9a51e4","Type":"ContainerStarted","Data":"2dcc1c8bb7b963a93b4d06493ba8f567936654c8696c519dee291e85f24ff41a"} Sep 11 02:46:10.931110 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.931060 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqx7h" event={"ID":"5848ccb9-517b-4f12-95b1-02a4d871129f","Type":"ContainerStarted","Data":"147ded9f76f371fcc14910f550f2ed6cdef6294470aa8853166777f2542ecbe6"} Sep 11 02:46:10.939495 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.939384 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" event={"ID":"14e7e23f-0ed3-42f2-9e33-a334091ea350","Type":"ContainerStarted","Data":"da28567bb654ec8dedc96e8d436898d3a7a3e4249ab27d1ab0ed76dcacd5867c"} Sep 11 02:46:10.950679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.950649 2557 generic.go:356] "Generic (PLEG): container finished" podID="b6ec539ca26d2e4159a969e91ec7af7f" containerID="3f50d21a6e2da0a3b443596229c9a9f48213c79926cb30ea2577f766580e2aa3" exitCode=0 Sep 11 02:46:10.950799 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.950737 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" event={"ID":"b6ec539ca26d2e4159a969e91ec7af7f","Type":"ContainerDied","Data":"3f50d21a6e2da0a3b443596229c9a9f48213c79926cb30ea2577f766580e2aa3"} Sep 11 02:46:10.958688 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.958660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdzkq" event={"ID":"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd","Type":"ContainerStarted","Data":"5cbf8c1209ea8a991f23b446668787a888ac9cc919862ec493a58085bf1b405e"} Sep 11 02:46:10.967692 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.967638 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-112.ec2.internal" podStartSLOduration=2.9676178650000002 podStartE2EDuration="2.967617865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:10.881230905 +0000 UTC m=+4.523565239" watchObservedRunningTime="2026-09-11 02:46:10.967617865 +0000 UTC m=+4.609952243" Sep 11 02:46:10.987758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:10.987630 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"c920eb84c85a399dca43682298f45a87b160c803b2beabbe18e7b1bdb65b92a7"} Sep 11 02:46:12.009652 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.009611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" event={"ID":"b6ec539ca26d2e4159a969e91ec7af7f","Type":"ContainerStarted","Data":"fcab40fc3e8d82710b1262071c6f70afd51c0bb1cb039d6a228ab33ae38e36be"} Sep 11 02:46:12.478807 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.478163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:12.478807 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.478218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:12.478807 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.478380 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:12.478807 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.478465 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:16.47842729 +0000 UTC m=+10.120761603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:12.488268 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.484663 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:12.488268 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.484753 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:16.484731185 +0000 UTC m=+10.127065514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:12.579597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.578941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:12.579597 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.579142 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:12.579597 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.579160 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:12.579597 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.579173 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:12.579597 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.579230 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:16.57921218 +0000 UTC m=+10.221546493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:12.836678 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.836594 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:12.836844 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.836732 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:12.837219 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.837194 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:12.837331 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.837304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:12.839018 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:12.838991 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:12.839134 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:12.839095 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:14.840959 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:14.840927 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:14.841466 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:14.840941 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:14.841466 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:14.841074 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:14.841466 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:14.841111 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:14.841466 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:14.841228 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:14.841466 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:14.841315 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:16.514545 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.514501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:16.514545 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.514547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:16.515061 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.514663 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:16.515061 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.514663 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:16.515061 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.514717 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:24.514702294 +0000 UTC m=+18.157036618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:16.515061 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.514731 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:24.514725051 +0000 UTC m=+18.157059358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:16.615931 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.615898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:16.616104 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.616079 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:16.616104 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.616100 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:16.616205 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.616114 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:16.616205 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.616167 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:24.616150033 +0000 UTC m=+18.258484356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:16.836169 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.836088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:16.836330 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.836192 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:16.836330 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.836200 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:16.836330 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.836289 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:16.836330 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:16.836320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:16.836542 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:16.836395 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:18.836002 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:18.835963 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:18.836487 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:18.836000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:18.836487 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:18.836105 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:18.836487 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:18.836182 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:18.836487 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:18.836315 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:18.836487 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:18.836441 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:20.836453 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:20.836147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:20.836453 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:20.836147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:20.836923 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:20.836481 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:20.836923 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:20.836254 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:20.836923 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:20.836564 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:20.836923 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:20.836666 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:22.835635 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:22.835603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:22.836095 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:22.835603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:22.836095 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:22.835724 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:22.836095 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:22.835823 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:22.836095 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:22.835603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:22.836095 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:22.835927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:24.575740 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.575655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:24.576138 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.575757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:24.576138 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.575819 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:24.576138 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.575899 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:40.57587634 +0000 UTC m=+34.218210648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:24.576138 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.575904 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:24.576138 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.575956 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:40.575938997 +0000 UTC m=+34.218273310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:24.676728 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.676691 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:24.676890 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.676868 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:24.676890 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.676889 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:24.676986 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.676898 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:24.676986 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.676945 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:46:40.676932145 +0000 UTC m=+34.319266452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:24.836072 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.835994 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:24.836230 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.835994 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:24.836230 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.836125 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:24.836230 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:24.836003 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:24.836230 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.836203 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:24.836458 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:24.836277 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:26.836216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:26.836176 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:26.836682 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:26.836270 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:26.836682 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:26.836359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:26.836682 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:26.836483 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:26.836682 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:26.836535 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:26.836682 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:26.836638 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:28.836295 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:28.836126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:28.837206 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:28.836127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:28.837206 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:28.836382 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:28.837206 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:28.836193 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:28.837206 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:28.836493 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:28.837206 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:28.836550 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:29.046332 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.046294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j95rw" event={"ID":"f6315050-4115-4755-9469-884121d46ebd","Type":"ContainerStarted","Data":"90a798e193f555a617f27f3866e27f5934e08feeffb89602315cae3401a30e8e"} Sep 11 02:46:29.050729 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.050703 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="4e73ae62cac88fceb67f1d68ef9fc5e8a1e2b95acbf21e1da4d8c82b5eebd75a" exitCode=0 Sep 11 02:46:29.050863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.050773 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"4e73ae62cac88fceb67f1d68ef9fc5e8a1e2b95acbf21e1da4d8c82b5eebd75a"} Sep 11 02:46:29.052334 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.052311 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dlj9c" event={"ID":"69eb83ca-8e97-4f03-9b08-1ac110899c25","Type":"ContainerStarted","Data":"a96542008c6c9b06abe060820a18b9ee7b8d95f28839527b3323a698f685d6ea"} Sep 11 02:46:29.053765 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.053739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" event={"ID":"08342c09-b4ce-4829-a634-880bce6c329f","Type":"ContainerStarted","Data":"801e67426765d7362e14522a6e533798e79b4d10bd05be5f8ebcba95162863a9"} Sep 11 02:46:29.055082 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.055063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pl8hn" event={"ID":"b8498562-4d72-46f3-a8db-5e6b7b9a51e4","Type":"ContainerStarted","Data":"c9fdb22f0f420abbb80c2384c6453106f12bd89332a163ecbeeeeb63b28a7ec2"} Sep 11 02:46:29.056379 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.056358 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" event={"ID":"14e7e23f-0ed3-42f2-9e33-a334091ea350","Type":"ContainerStarted","Data":"8b5c795de9b4a61eaadf5fc8dfc96c6d37b100c38c8868062ab08f12e21da562"} Sep 11 02:46:29.057753 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.057737 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdzkq" event={"ID":"bbfda7b3-e2e7-4f82-a45d-beba8696a4dd","Type":"ContainerStarted","Data":"cd22075890826c0f7c3d093cd455611f26f61b0bc4a61d4d32b1dc7057f16005"} Sep 11 02:46:29.060287 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060271 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:46:29.060639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060622 2557 generic.go:356] "Generic (PLEG): container finished" podID="8fb58ba3-6b9c-449d-9699-c49e0492f065" containerID="830b55e864477276321c975d6528beffa33149b592f8ee72587af0594ad973d1" exitCode=1 Sep 11 02:46:29.060695 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060649 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"19a442042c6e087ba51fb126760d1dab7d25c1b9c8e55a90411ef26220793551"} Sep 11 02:46:29.060695 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060692 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"f9ec39ed3796ab2effe4ac8c06db99c9c3ce553496efe3a117ff9be4c77a5b21"} Sep 11 02:46:29.060759 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060722 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"2e29e24d6f2bd96c3282387ab30ee51f9c70d5fe195875f591112dac5bf4b7bd"} Sep 11 02:46:29.060759 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060749 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"6d26fccc560f2476e4d483c95da0a1e65d53b8afa7f10efce1f5a79efe892918"} Sep 11 02:46:29.060818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerDied","Data":"830b55e864477276321c975d6528beffa33149b592f8ee72587af0594ad973d1"} Sep 11 02:46:29.060818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.060804 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"aeec5a2a3e9f59e991dfa4a5a3a90d78e9c285c61dcf84c50100a1c7c7f34252"} Sep 11 02:46:29.061088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.061056 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j95rw" podStartSLOduration=4.160067413 podStartE2EDuration="22.061043934s" totalImagesPullingTime="17.900976521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:29.06050604 +0000 UTC m=+22.702840372" watchObservedRunningTime="2026-09-11 02:46:29.061043934 +0000 UTC m=+22.703378263" Sep 11 02:46:29.061134 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.061120 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-112.ec2.internal" podStartSLOduration=21.061115174 podStartE2EDuration="21.061115174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:12.026525898 +0000 UTC m=+5.668860223" watchObservedRunningTime="2026-09-11 02:46:29.061115174 +0000 UTC m=+22.703449503" Sep 11 02:46:29.097990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.097941 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pl8hn" podStartSLOduration=7.968258446 podStartE2EDuration="22.09792599s" totalImagesPullingTime="14.129667544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:29.097736083 +0000 UTC m=+22.740070424" watchObservedRunningTime="2026-09-11 02:46:29.09792599 +0000 UTC m=+22.740260318" Sep 11 02:46:29.127584 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.127542 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s2sfr" podStartSLOduration=4.224614375 podStartE2EDuration="22.127526227s" totalImagesPullingTime="17.902911852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:29.127151709 +0000 UTC m=+22.769486038" watchObservedRunningTime="2026-09-11 02:46:29.127526227 +0000 UTC m=+22.769860599" Sep 11 02:46:29.127740 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.127629 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dlj9c" podStartSLOduration=4.235738686 podStartE2EDuration="22.127623492s" totalImagesPullingTime="17.891884806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:29.113192847 +0000 UTC m=+22.755527177" watchObservedRunningTime="2026-09-11 02:46:29.127623492 +0000 UTC m=+22.769957856" Sep 11 02:46:29.141003 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.140947 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdzkq" podStartSLOduration=3.860726016 podStartE2EDuration="22.14093784s" totalImagesPullingTime="18.280211824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:29.140380027 +0000 UTC m=+22.782714357" watchObservedRunningTime="2026-09-11 02:46:29.14093784 +0000 UTC m=+22.783272169" Sep 11 02:46:29.884427 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:29.884254 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 02:46:30.064864 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.064738 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqx7h" event={"ID":"5848ccb9-517b-4f12-95b1-02a4d871129f","Type":"ContainerStarted","Data":"9f8014b319816472573f3937d5076c78f30ac278e33e7deff57bd3bc13343b13"} Sep 11 02:46:30.067132 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.067102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" event={"ID":"14e7e23f-0ed3-42f2-9e33-a334091ea350","Type":"ContainerStarted","Data":"132ca5fbb4e9aaf1f0715d884e292db86a07b965811e241dd9e2f2ea35e72463"} Sep 11 02:46:30.078474 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.078433 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cqx7h" podStartSLOduration=5.169918687 podStartE2EDuration="23.078420066s" totalImagesPullingTime="17.908501379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:30.078191776 +0000 UTC m=+23.720526106" watchObservedRunningTime="2026-09-11 02:46:30.078420066 +0000 UTC m=+23.720754390" Sep 11 02:46:30.704015 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.703970 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:30.705044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.705022 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:30.816994 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.816855 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T02:46:29.884394508Z","UUID":"d40f2774-8191-48de-97fc-3864c233cc3c","Handler":null,"Name":"","Endpoint":""} Sep 11 02:46:30.818472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.818443 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 02:46:30.818607 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.818480 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 02:46:30.836008 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.835976 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:30.836173 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.835978 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:30.836173 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:30.836115 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:30.836173 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:30.836128 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:30.836376 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:30.836343 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:30.836523 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:30.836457 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:31.072538 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.072495 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" event={"ID":"14e7e23f-0ed3-42f2-9e33-a334091ea350","Type":"ContainerStarted","Data":"cb8dcfff5ac8fcfa34acdd3818272da86a2b59bc6b2e39b488cd8b7ae205fc2d"} Sep 11 02:46:31.076206 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.076180 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:46:31.076695 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.076604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"4c44ce425efc555a7df6958953d86e66d0985435cd5d10c8fdc6512405b02f7a"} Sep 11 02:46:31.076924 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.076905 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:31.077566 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.077544 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pl8hn" Sep 11 02:46:31.090692 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:31.090656 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x68h" podStartSLOduration=3.763586666 podStartE2EDuration="24.090643972s" totalImagesPullingTime="20.327057306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:31.09023146 +0000 UTC m=+24.732565785" watchObservedRunningTime="2026-09-11 02:46:31.090643972 +0000 UTC m=+24.732978299" Sep 11 02:46:32.835860 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:32.835827 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:32.835860 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:32.835862 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:32.836491 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:32.835832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:32.836491 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:32.835949 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:32.836491 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:32.836032 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:32.836491 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:32.836108 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:34.836225 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:34.836063 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:34.836777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:34.836077 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:34.836777 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:34.836300 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:34.836777 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:34.836440 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:34.836777 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:34.836107 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:34.836777 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:34.836519 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:35.087872 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.087788 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="e77fe8717134d42538719606faf95b8c83be8a79a3375c3b8046cb086694229f" exitCode=0 Sep 11 02:46:35.087872 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.087834 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"e77fe8717134d42538719606faf95b8c83be8a79a3375c3b8046cb086694229f"} Sep 11 02:46:35.091703 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.091685 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:46:35.092080 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.092053 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"c4c77e2862d15422ee6b779323bf0db0c0372d71da0db0753fa011b99233509d"} Sep 11 02:46:35.092301 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.092284 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:35.092378 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.092348 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:35.092542 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.092527 2557 scope.go:117] "RemoveContainer" containerID="830b55e864477276321c975d6528beffa33149b592f8ee72587af0594ad973d1" Sep 11 02:46:35.109096 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:35.109075 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:36.097978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.097949 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:46:36.098565 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.098336 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" event={"ID":"8fb58ba3-6b9c-449d-9699-c49e0492f065","Type":"ContainerStarted","Data":"8c1ca0a40f16db16522340212e9a877f0b032262df03a607a10b7d81890531dc"} Sep 11 02:46:36.098660 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.098644 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:36.102873 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.102839 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="79d452fa1ef186325320f7bb67b2214386a367e63cac0021e1d4e1a8d93c8559" exitCode=0 Sep 11 02:46:36.103027 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.102897 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"79d452fa1ef186325320f7bb67b2214386a367e63cac0021e1d4e1a8d93c8559"} Sep 11 02:46:36.115337 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.115314 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:46:36.129343 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.129299 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" podStartSLOduration=11.203214549 podStartE2EDuration="29.129286248s" totalImagesPullingTime="17.926071699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:36.128128703 +0000 UTC m=+29.770463036" watchObservedRunningTime="2026-09-11 02:46:36.129286248 +0000 UTC m=+29.771620577" Sep 11 02:46:36.836066 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.836027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:36.836264 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.836096 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:36.836264 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:36.836106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:36.836264 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:36.836198 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:36.836264 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:36.836251 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:36.836484 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:36.836322 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:38.110377 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:38.110337 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="b8c5d1de6d6b48da7466e5d32563f001422006349b5daf3c6bc85ec066284857" exitCode=0 Sep 11 02:46:38.110834 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:38.110377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"b8c5d1de6d6b48da7466e5d32563f001422006349b5daf3c6bc85ec066284857"} Sep 11 02:46:38.835501 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:38.835467 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:38.835667 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:38.835528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:38.835667 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:38.835531 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:38.835667 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:38.835651 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:38.835837 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:38.835724 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:38.835837 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:38.835798 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:40.593598 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.593554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:40.593598 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.593602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:40.594169 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.593728 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:40.594169 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.593738 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:40.594169 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.593799 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret podName:8ce6e9ac-6d30-4ab2-8352-fa437f399915 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:12.593779769 +0000 UTC m=+66.236114078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret") pod "global-pull-secret-syncer-4pjvl" (UID: "8ce6e9ac-6d30-4ab2-8352-fa437f399915") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:46:40.594169 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.593818 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs podName:30405c0e-1372-4d3c-9d73-6e09e0d31b36 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:12.593809975 +0000 UTC m=+66.236144283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs") pod "network-metrics-daemon-wqxx6" (UID: "30405c0e-1372-4d3c-9d73-6e09e0d31b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:46:40.694071 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.694037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:40.694225 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.694210 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:46:40.694270 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.694234 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:46:40.694270 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.694244 2557 projected.go:196] Error preparing data for projected volume kube-api-access-t5crd for pod openshift-network-diagnostics/network-check-target-g8p6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:40.694331 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.694302 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd podName:7d132393-a6d3-416a-a6c7-8c0184476e36 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:12.694285346 +0000 UTC m=+66.336619683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5crd" (UniqueName: "kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd") pod "network-check-target-g8p6h" (UID: "7d132393-a6d3-416a-a6c7-8c0184476e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:46:40.838937 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.838899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:40.839111 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.838977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:40.839111 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:40.838986 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:40.839226 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.839112 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:40.839226 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.839141 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:40.839226 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:40.839198 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:42.835778 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:42.835750 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:42.836187 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:42.835750 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:42.836187 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:42.835857 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:42.836187 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:42.835871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:42.836187 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:42.835943 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:42.836187 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:42.836037 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:43.126142 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:43.126056 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="e1437750f6fb8e7a69db73c3c8e09b4ec2f1e6eaf3a1de6c42e3d0af0b289b97" exitCode=0 Sep 11 02:46:43.126142 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:43.126116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"e1437750f6fb8e7a69db73c3c8e09b4ec2f1e6eaf3a1de6c42e3d0af0b289b97"} Sep 11 02:46:44.131975 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:44.131944 2557 generic.go:356] "Generic (PLEG): container finished" podID="af59951d-ddb6-4978-941a-000bc10b07ed" containerID="b294bba78e50c57c5810f208b6293bb76548b66ce3e21ec2f4fb6a4c3cae2ba9" exitCode=0 Sep 11 02:46:44.132332 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:44.132003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerDied","Data":"b294bba78e50c57c5810f208b6293bb76548b66ce3e21ec2f4fb6a4c3cae2ba9"} Sep 11 02:46:44.836572 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:44.836294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:44.836736 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:44.836300 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:44.836736 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:44.836670 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:44.836736 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:44.836368 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:44.836857 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:44.836730 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:44.836857 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:44.836817 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:45.138053 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:45.137969 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24b84" event={"ID":"af59951d-ddb6-4978-941a-000bc10b07ed","Type":"ContainerStarted","Data":"095b134e9bc4ed063a18b28af50709e87bf970f76f5f7ef7b8785cda54e787a3"} Sep 11 02:46:45.159551 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:45.159498 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-24b84" podStartSLOduration=12.79052214 podStartE2EDuration="38.159481457s" totalImagesPullingTime="25.368959317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:46:45.158915176 +0000 UTC m=+38.801249504" watchObservedRunningTime="2026-09-11 02:46:45.159481457 +0000 UTC m=+38.801815786" Sep 11 02:46:46.836969 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:46.836936 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:46.837440 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:46.837027 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:46.837440 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:46.837033 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:46.837440 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:46.837104 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:46.837440 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:46.837122 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:46.837440 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:46.837174 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:48.835306 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:48.835278 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:48.835306 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:48.835294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:48.835817 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:48.835395 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:48.835817 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:48.835497 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:48.835817 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:48.835513 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:48.835817 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:48.835613 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:50.350692 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.350659 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4pjvl"] Sep 11 02:46:50.355594 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.351546 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:50.355594 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:50.351701 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:50.355594 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.355268 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g8p6h"] Sep 11 02:46:50.355594 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.355434 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:50.355594 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:50.355573 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:50.356536 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.355797 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqxx6"] Sep 11 02:46:50.356896 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:50.356861 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:50.357021 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:50.356968 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:51.836262 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:51.836220 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:51.836708 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:51.836220 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:51.836708 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:51.836333 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:51.836708 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:51.836244 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:51.836708 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:51.836424 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:51.836708 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:51.836523 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:53.835817 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:53.835787 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:53.835817 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:53.835801 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:53.836188 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:53.835801 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:53.836188 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:53.835893 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqxx6" podUID="30405c0e-1372-4d3c-9d73-6e09e0d31b36" Sep 11 02:46:53.836188 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:53.835944 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8p6h" podUID="7d132393-a6d3-416a-a6c7-8c0184476e36" Sep 11 02:46:53.836188 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:46:53.836018 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4pjvl" podUID="8ce6e9ac-6d30-4ab2-8352-fa437f399915" Sep 11 02:46:54.115340 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.115269 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-112.ec2.internal" event="NodeReady" Sep 11 02:46:54.115529 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.115422 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 02:46:54.157932 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.157894 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c8djx"] Sep 11 02:46:54.187976 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.187950 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fzvl9"] Sep 11 02:46:54.188132 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.188072 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.190421 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.190377 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 02:46:54.190964 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.190939 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 02:46:54.191076 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.191000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4jwj\"" Sep 11 02:46:54.200703 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.200559 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c8djx"] Sep 11 02:46:54.200769 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.200724 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fzvl9"] Sep 11 02:46:54.200769 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.200740 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mbhjf"] Sep 11 02:46:54.200834 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.200665 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.202938 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.202916 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 02:46:54.203046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.202955 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 02:46:54.203046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.202993 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2f5pw\"" Sep 11 02:46:54.203152 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.203127 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 02:46:54.222626 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.222606 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbhjf"] Sep 11 02:46:54.222738 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.222709 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.225011 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.224987 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 02:46:54.225128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.225031 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 02:46:54.225128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.225037 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 02:46:54.225128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.225033 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 02:46:54.225261 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.225152 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nlkww\"" Sep 11 02:46:54.288646 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288619 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4dd375-455a-48c5-bc69-a96d8b5af794-cert\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.288646 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288652 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dce86686-f513-4061-9d2b-3e5c377471dc-metrics-tls\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.288832 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dce86686-f513-4061-9d2b-3e5c377471dc-config-volume\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.288832 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dce86686-f513-4061-9d2b-3e5c377471dc-tmp-dir\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.288832 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vx6w\" (UniqueName: \"kubernetes.io/projected/dce86686-f513-4061-9d2b-3e5c377471dc-kube-api-access-5vx6w\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.288924 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.288835 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsksw\" (UniqueName: \"kubernetes.io/projected/8f4dd375-455a-48c5-bc69-a96d8b5af794-kube-api-access-lsksw\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.390006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.389927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dce86686-f513-4061-9d2b-3e5c377471dc-tmp-dir\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.390006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.389963 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vx6w\" (UniqueName: \"kubernetes.io/projected/dce86686-f513-4061-9d2b-3e5c377471dc-kube-api-access-5vx6w\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.390006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.389990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsksw\" (UniqueName: \"kubernetes.io/projected/8f4dd375-455a-48c5-bc69-a96d8b5af794-kube-api-access-lsksw\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.390216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390126 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20c553f6-5881-4db4-8bea-ab45c8ec25dd-crio-socket\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.390216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20c553f6-5881-4db4-8bea-ab45c8ec25dd-data-volume\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.390216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20c553f6-5881-4db4-8bea-ab45c8ec25dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.390216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4dd375-455a-48c5-bc69-a96d8b5af794-cert\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.390391 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dce86686-f513-4061-9d2b-3e5c377471dc-metrics-tls\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.390391 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.390391 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn5n\" (UniqueName: \"kubernetes.io/projected/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-api-access-7dn5n\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.390391 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dce86686-f513-4061-9d2b-3e5c377471dc-config-volume\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.390614 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390558 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dce86686-f513-4061-9d2b-3e5c377471dc-tmp-dir\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.390848 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.390826 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dce86686-f513-4061-9d2b-3e5c377471dc-config-volume\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.394196 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.394173 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dce86686-f513-4061-9d2b-3e5c377471dc-metrics-tls\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.394290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.394245 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4dd375-455a-48c5-bc69-a96d8b5af794-cert\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.397013 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.396992 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vx6w\" (UniqueName: \"kubernetes.io/projected/dce86686-f513-4061-9d2b-3e5c377471dc-kube-api-access-5vx6w\") pod \"dns-default-c8djx\" (UID: \"dce86686-f513-4061-9d2b-3e5c377471dc\") " pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.397089 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.397064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsksw\" (UniqueName: \"kubernetes.io/projected/8f4dd375-455a-48c5-bc69-a96d8b5af794-kube-api-access-lsksw\") pod \"ingress-canary-fzvl9\" (UID: \"8f4dd375-455a-48c5-bc69-a96d8b5af794\") " pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.491234 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn5n\" (UniqueName: \"kubernetes.io/projected/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-api-access-7dn5n\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20c553f6-5881-4db4-8bea-ab45c8ec25dd-crio-socket\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491302 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20c553f6-5881-4db4-8bea-ab45c8ec25dd-data-volume\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20c553f6-5881-4db4-8bea-ab45c8ec25dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491641 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491623 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20c553f6-5881-4db4-8bea-ab45c8ec25dd-crio-socket\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491676 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491654 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20c553f6-5881-4db4-8bea-ab45c8ec25dd-data-volume\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.491949 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.491918 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.493787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.493769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20c553f6-5881-4db4-8bea-ab45c8ec25dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.498323 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.498302 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn5n\" (UniqueName: \"kubernetes.io/projected/20c553f6-5881-4db4-8bea-ab45c8ec25dd-kube-api-access-7dn5n\") pod \"insights-runtime-extractor-mbhjf\" (UID: \"20c553f6-5881-4db4-8bea-ab45c8ec25dd\") " pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.498449 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.498420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c8djx" Sep 11 02:46:54.508219 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.508201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fzvl9" Sep 11 02:46:54.530488 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.530467 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbhjf" Sep 11 02:46:54.816979 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.816946 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c8djx"] Sep 11 02:46:54.820526 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:54.820500 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce86686_f513_4061_9d2b_3e5c377471dc.slice/crio-81a64ab3b863bf4eeecf9d004edd46c8c1f5730238af60bcc070f34e6519f216 WatchSource:0}: Error finding container 81a64ab3b863bf4eeecf9d004edd46c8c1f5730238af60bcc070f34e6519f216: Status 404 returned error can't find the container with id 81a64ab3b863bf4eeecf9d004edd46c8c1f5730238af60bcc070f34e6519f216 Sep 11 02:46:54.841994 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.841962 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fzvl9"] Sep 11 02:46:54.845551 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:54.845521 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4dd375_455a_48c5_bc69_a96d8b5af794.slice/crio-290f347dfb7a2a2ac2c9a212eaf52f23dc3112824eed26235a516071a68cf60d WatchSource:0}: Error finding container 290f347dfb7a2a2ac2c9a212eaf52f23dc3112824eed26235a516071a68cf60d: Status 404 returned error can't find the container with id 290f347dfb7a2a2ac2c9a212eaf52f23dc3112824eed26235a516071a68cf60d Sep 11 02:46:54.854748 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:54.854725 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbhjf"] Sep 11 02:46:54.857699 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:46:54.857672 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c553f6_5881_4db4_8bea_ab45c8ec25dd.slice/crio-f069d643d846ef685d4cca194b01b8fb19f8fe24cd63b0e77918fab26bb7e05a WatchSource:0}: Error finding container f069d643d846ef685d4cca194b01b8fb19f8fe24cd63b0e77918fab26bb7e05a: Status 404 returned error can't find the container with id f069d643d846ef685d4cca194b01b8fb19f8fe24cd63b0e77918fab26bb7e05a Sep 11 02:46:55.163077 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.163045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbhjf" event={"ID":"20c553f6-5881-4db4-8bea-ab45c8ec25dd","Type":"ContainerStarted","Data":"14a13de466df12a1ac1d401f5e18a47428a6af9f3f462989ec3a153779cbd46e"} Sep 11 02:46:55.163220 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.163108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbhjf" event={"ID":"20c553f6-5881-4db4-8bea-ab45c8ec25dd","Type":"ContainerStarted","Data":"f069d643d846ef685d4cca194b01b8fb19f8fe24cd63b0e77918fab26bb7e05a"} Sep 11 02:46:55.164274 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.164257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fzvl9" event={"ID":"8f4dd375-455a-48c5-bc69-a96d8b5af794","Type":"ContainerStarted","Data":"290f347dfb7a2a2ac2c9a212eaf52f23dc3112824eed26235a516071a68cf60d"} Sep 11 02:46:55.165378 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.165357 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c8djx" event={"ID":"dce86686-f513-4061-9d2b-3e5c377471dc","Type":"ContainerStarted","Data":"81a64ab3b863bf4eeecf9d004edd46c8c1f5730238af60bcc070f34e6519f216"} Sep 11 02:46:55.836349 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.836163 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:46:55.836589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.836210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:46:55.836589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.836210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:46:55.839987 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.839962 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:46:55.840115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.840096 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-thvxl\"" Sep 11 02:46:55.840175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.840161 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hvpdd\"" Sep 11 02:46:55.840221 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.840175 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:46:55.840280 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.840264 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:46:55.840394 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:55.840380 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:46:56.172003 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:46:56.171941 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbhjf" event={"ID":"20c553f6-5881-4db4-8bea-ab45c8ec25dd","Type":"ContainerStarted","Data":"085bc1cd5bff06a94f216c202a2e721f9ebb4e2165627e49a67fb39b69591ced"} Sep 11 02:47:00.183893 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.183634 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbhjf" event={"ID":"20c553f6-5881-4db4-8bea-ab45c8ec25dd","Type":"ContainerStarted","Data":"e166999026b5a1d482940a81867f31eca61f2b6ca1593fed4cd5b138fde4fbd0"} Sep 11 02:47:00.185066 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.185044 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fzvl9" event={"ID":"8f4dd375-455a-48c5-bc69-a96d8b5af794","Type":"ContainerStarted","Data":"f3dc9a2db103c5886d870ee9a45019964a1c594e91bac7de7f4ca7a8817370aa"} Sep 11 02:47:00.186709 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.186688 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c8djx" event={"ID":"dce86686-f513-4061-9d2b-3e5c377471dc","Type":"ContainerStarted","Data":"5a90b18b5f3c5c236bf598a59407e9bf68b1464c3676a94faeaae1b245fe41e1"} Sep 11 02:47:00.186788 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.186726 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c8djx" event={"ID":"dce86686-f513-4061-9d2b-3e5c377471dc","Type":"ContainerStarted","Data":"30caf7376bf3ce3fa7747b93d5e4786401804b1e75afee815607c0732f9e4647"} Sep 11 02:47:00.186827 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.186815 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c8djx" Sep 11 02:47:00.200580 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.200546 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mbhjf" podStartSLOduration=1.815995896 podStartE2EDuration="6.200534921s" totalImagesPullingTime="4.384539025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:00.200133328 +0000 UTC m=+53.842467656" watchObservedRunningTime="2026-09-11 02:47:00.200534921 +0000 UTC m=+53.842869243" Sep 11 02:47:00.240690 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.240644 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c8djx" podStartSLOduration=1.55200959 podStartE2EDuration="6.24062983s" totalImagesPullingTime="4.68862024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:00.2403612 +0000 UTC m=+53.882695528" watchObservedRunningTime="2026-09-11 02:47:00.24062983 +0000 UTC m=+53.882964158" Sep 11 02:47:00.269362 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:00.269324 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fzvl9" podStartSLOduration=1.599015503 podStartE2EDuration="6.269312049s" totalImagesPullingTime="4.670296546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:00.268738924 +0000 UTC m=+53.911073267" watchObservedRunningTime="2026-09-11 02:47:00.269312049 +0000 UTC m=+53.911646377" Sep 11 02:47:08.121987 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:08.121958 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp5jm" Sep 11 02:47:10.191905 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:10.191874 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c8djx" Sep 11 02:47:11.646314 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.646285 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-khhcg"] Sep 11 02:47:11.648931 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.648913 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:11.651778 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.651757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mmcjz\"" Sep 11 02:47:11.652026 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.652001 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 02:47:11.652426 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.652392 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 02:47:11.668801 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.668771 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-khhcg"] Sep 11 02:47:11.813416 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.813378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdwst\" (UniqueName: \"kubernetes.io/projected/936c815e-4056-4baa-accf-3f0285f8d44e-kube-api-access-qdwst\") pod \"downloads-76f99584f4-khhcg\" (UID: \"936c815e-4056-4baa-accf-3f0285f8d44e\") " pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:11.914218 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.914139 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdwst\" (UniqueName: \"kubernetes.io/projected/936c815e-4056-4baa-accf-3f0285f8d44e-kube-api-access-qdwst\") pod \"downloads-76f99584f4-khhcg\" (UID: \"936c815e-4056-4baa-accf-3f0285f8d44e\") " pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:11.924810 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.924787 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdwst\" (UniqueName: \"kubernetes.io/projected/936c815e-4056-4baa-accf-3f0285f8d44e-kube-api-access-qdwst\") pod \"downloads-76f99584f4-khhcg\" (UID: \"936c815e-4056-4baa-accf-3f0285f8d44e\") " pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:11.960638 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:11.960602 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:12.235063 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.234983 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-khhcg"] Sep 11 02:47:12.237799 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:12.237768 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936c815e_4056_4baa_accf_3f0285f8d44e.slice/crio-15de274836ce6d65b9367c7caa9ad014c7479443653185283a78e1f7a1bc86e8 WatchSource:0}: Error finding container 15de274836ce6d65b9367c7caa9ad014c7479443653185283a78e1f7a1bc86e8: Status 404 returned error can't find the container with id 15de274836ce6d65b9367c7caa9ad014c7479443653185283a78e1f7a1bc86e8 Sep 11 02:47:12.620417 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.620316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:47:12.620417 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.620351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:47:12.623210 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.623186 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:47:12.623210 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.623204 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:47:12.633128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.633105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ce6e9ac-6d30-4ab2-8352-fa437f399915-original-pull-secret\") pod \"global-pull-secret-syncer-4pjvl\" (UID: \"8ce6e9ac-6d30-4ab2-8352-fa437f399915\") " pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:47:12.633128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.633121 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30405c0e-1372-4d3c-9d73-6e09e0d31b36-metrics-certs\") pod \"network-metrics-daemon-wqxx6\" (UID: \"30405c0e-1372-4d3c-9d73-6e09e0d31b36\") " pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:47:12.646662 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.646644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4pjvl" Sep 11 02:47:12.655115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.655090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hvpdd\"" Sep 11 02:47:12.663188 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.663166 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqxx6" Sep 11 02:47:12.722042 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.721592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:47:12.724635 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.724598 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:47:12.736787 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.734991 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:47:12.746474 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.746444 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5crd\" (UniqueName: \"kubernetes.io/projected/7d132393-a6d3-416a-a6c7-8c0184476e36-kube-api-access-t5crd\") pod \"network-check-target-g8p6h\" (UID: \"7d132393-a6d3-416a-a6c7-8c0184476e36\") " pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:47:12.932770 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.932741 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4pjvl"] Sep 11 02:47:12.936980 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:12.936958 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce6e9ac_6d30_4ab2_8352_fa437f399915.slice/crio-28fdb444c032edf341bba4bb4724bf164cc3e491a88b3f7995f66c270ef77964 WatchSource:0}: Error finding container 28fdb444c032edf341bba4bb4724bf164cc3e491a88b3f7995f66c270ef77964: Status 404 returned error can't find the container with id 28fdb444c032edf341bba4bb4724bf164cc3e491a88b3f7995f66c270ef77964 Sep 11 02:47:12.957289 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.957262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqxx6"] Sep 11 02:47:12.958687 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.958666 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-thvxl\"" Sep 11 02:47:12.959907 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:12.959885 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30405c0e_1372_4d3c_9d73_6e09e0d31b36.slice/crio-78cbc6fc6eede1554615adbac8bab7a57e646ea382f3752c7f2658dc42bab936 WatchSource:0}: Error finding container 78cbc6fc6eede1554615adbac8bab7a57e646ea382f3752c7f2658dc42bab936: Status 404 returned error can't find the container with id 78cbc6fc6eede1554615adbac8bab7a57e646ea382f3752c7f2658dc42bab936 Sep 11 02:47:12.966687 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:12.966668 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:47:13.227900 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.227823 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxx6" event={"ID":"30405c0e-1372-4d3c-9d73-6e09e0d31b36","Type":"ContainerStarted","Data":"78cbc6fc6eede1554615adbac8bab7a57e646ea382f3752c7f2658dc42bab936"} Sep 11 02:47:13.229148 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.229113 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4pjvl" event={"ID":"8ce6e9ac-6d30-4ab2-8352-fa437f399915","Type":"ContainerStarted","Data":"28fdb444c032edf341bba4bb4724bf164cc3e491a88b3f7995f66c270ef77964"} Sep 11 02:47:13.230489 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.230464 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-khhcg" event={"ID":"936c815e-4056-4baa-accf-3f0285f8d44e","Type":"ContainerStarted","Data":"15de274836ce6d65b9367c7caa9ad014c7479443653185283a78e1f7a1bc86e8"} Sep 11 02:47:13.254726 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.254702 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g8p6h"] Sep 11 02:47:13.257875 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:13.257851 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d132393_a6d3_416a_a6c7_8c0184476e36.slice/crio-4f7e7e86bdd750bf5819a136857e6f83f5f1ed014bad46be7c0f29ea94e19f5b WatchSource:0}: Error finding container 4f7e7e86bdd750bf5819a136857e6f83f5f1ed014bad46be7c0f29ea94e19f5b: Status 404 returned error can't find the container with id 4f7e7e86bdd750bf5819a136857e6f83f5f1ed014bad46be7c0f29ea94e19f5b Sep 11 02:47:13.776441 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.776393 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt"] Sep 11 02:47:13.790130 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.789748 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt"] Sep 11 02:47:13.790130 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.789810 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:13.794175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.793981 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 11 02:47:13.794175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.794066 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vkq9m\"" Sep 11 02:47:13.829727 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.829623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b82c9f-7915-4956-a0a3-63c7185f762c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fj5dt\" (UID: \"57b82c9f-7915-4956-a0a3-63c7185f762c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:13.932479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.931825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b82c9f-7915-4956-a0a3-63c7185f762c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fj5dt\" (UID: \"57b82c9f-7915-4956-a0a3-63c7185f762c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:13.935829 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:13.935804 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b82c9f-7915-4956-a0a3-63c7185f762c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fj5dt\" (UID: \"57b82c9f-7915-4956-a0a3-63c7185f762c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:14.104217 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:14.103877 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:14.241682 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:14.241639 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g8p6h" event={"ID":"7d132393-a6d3-416a-a6c7-8c0184476e36","Type":"ContainerStarted","Data":"4f7e7e86bdd750bf5819a136857e6f83f5f1ed014bad46be7c0f29ea94e19f5b"} Sep 11 02:47:14.468466 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:14.467809 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt"] Sep 11 02:47:14.473836 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:14.473805 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b82c9f_7915_4956_a0a3_63c7185f762c.slice/crio-71a5c343d041b1e11cb20cadec685809648f08a2f19a687671d5088a6060ad1b WatchSource:0}: Error finding container 71a5c343d041b1e11cb20cadec685809648f08a2f19a687671d5088a6060ad1b: Status 404 returned error can't find the container with id 71a5c343d041b1e11cb20cadec685809648f08a2f19a687671d5088a6060ad1b Sep 11 02:47:15.250947 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:15.250912 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxx6" event={"ID":"30405c0e-1372-4d3c-9d73-6e09e0d31b36","Type":"ContainerStarted","Data":"c51580667ebf3e645cb1e997507d990c61639783333c12a8de4d2bf558b3fe98"} Sep 11 02:47:15.251383 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:15.250980 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqxx6" event={"ID":"30405c0e-1372-4d3c-9d73-6e09e0d31b36","Type":"ContainerStarted","Data":"cd2a5eead624c75a806f58d96082da934809b03203e6214e7428b18cc6944161"} Sep 11 02:47:15.253723 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:15.253696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" event={"ID":"57b82c9f-7915-4956-a0a3-63c7185f762c","Type":"ContainerStarted","Data":"71a5c343d041b1e11cb20cadec685809648f08a2f19a687671d5088a6060ad1b"} Sep 11 02:47:15.268532 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:15.268276 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wqxx6" podStartSLOduration=67.021975253 podStartE2EDuration="1m8.268258761s" totalImagesPullingTime="1.246283508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:15.267812229 +0000 UTC m=+68.910146561" watchObservedRunningTime="2026-09-11 02:47:15.268258761 +0000 UTC m=+68.910593092" Sep 11 02:47:16.261116 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.260510 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" event={"ID":"57b82c9f-7915-4956-a0a3-63c7185f762c","Type":"ContainerStarted","Data":"d0995285f8cf2ae49f7bb404fcd7c06329f34c7290e3f81dcdae96b25c88c40e"} Sep 11 02:47:16.261116 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.260806 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:16.267100 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.267076 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" Sep 11 02:47:16.294432 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.293782 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fj5dt" podStartSLOduration=1.784975899 podStartE2EDuration="3.293764609s" totalImagesPullingTime="1.50878871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:16.277346233 +0000 UTC m=+69.919680563" watchObservedRunningTime="2026-09-11 02:47:16.293764609 +0000 UTC m=+69.936098940" Sep 11 02:47:16.829162 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.829131 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wj82r"] Sep 11 02:47:16.831268 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.831242 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.833692 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.833668 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 11 02:47:16.834022 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.834005 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 02:47:16.834263 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.834250 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 02:47:16.835009 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.834989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 11 02:47:16.835121 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.835058 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tmshb\"" Sep 11 02:47:16.835121 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.834996 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 02:47:16.843935 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.843913 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wj82r"] Sep 11 02:47:16.851119 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.851096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c627a6a-9156-451b-a30f-198314adc348-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.851210 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.851131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gc7\" (UniqueName: \"kubernetes.io/projected/0c627a6a-9156-451b-a30f-198314adc348-kube-api-access-69gc7\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.851210 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.851167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.851322 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.851220 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.952161 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.952125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c627a6a-9156-451b-a30f-198314adc348-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.952348 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.952172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gc7\" (UniqueName: \"kubernetes.io/projected/0c627a6a-9156-451b-a30f-198314adc348-kube-api-access-69gc7\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.952348 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.952209 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.952348 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.952264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.952549 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:16.952361 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 11 02:47:16.952549 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:16.952446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls podName:0c627a6a-9156-451b-a30f-198314adc348 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:17.452423331 +0000 UTC m=+71.094757640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-wj82r" (UID: "0c627a6a-9156-451b-a30f-198314adc348") : secret "prometheus-operator-tls" not found Sep 11 02:47:16.953048 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.953022 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c627a6a-9156-451b-a30f-198314adc348-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.955523 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.955484 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:16.961538 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:16.961516 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gc7\" (UniqueName: \"kubernetes.io/projected/0c627a6a-9156-451b-a30f-198314adc348-kube-api-access-69gc7\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:17.455213 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:17.455176 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:17.458028 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:17.458007 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c627a6a-9156-451b-a30f-198314adc348-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wj82r\" (UID: \"0c627a6a-9156-451b-a30f-198314adc348\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:17.743693 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:17.743611 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" Sep 11 02:47:19.251119 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.250952 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wj82r"] Sep 11 02:47:19.255781 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:19.255752 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c627a6a_9156_451b_a30f_198314adc348.slice/crio-93a2d2207639b9bf12bb3791197af6dc9ad82608057446519efea8a2e8b5059d WatchSource:0}: Error finding container 93a2d2207639b9bf12bb3791197af6dc9ad82608057446519efea8a2e8b5059d: Status 404 returned error can't find the container with id 93a2d2207639b9bf12bb3791197af6dc9ad82608057446519efea8a2e8b5059d Sep 11 02:47:19.273963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.273927 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4pjvl" event={"ID":"8ce6e9ac-6d30-4ab2-8352-fa437f399915","Type":"ContainerStarted","Data":"adedf605336e40190cec647c3c96a9552a1519d41b7360250ef022dbed73337e"} Sep 11 02:47:19.276186 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.276132 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g8p6h" event={"ID":"7d132393-a6d3-416a-a6c7-8c0184476e36","Type":"ContainerStarted","Data":"5a0e1c34bbe1b48d3255c5554dd35967f74c50ca356354b57944e03b4fecf8c7"} Sep 11 02:47:19.276291 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.276251 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:47:19.277505 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.277485 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" event={"ID":"0c627a6a-9156-451b-a30f-198314adc348","Type":"ContainerStarted","Data":"93a2d2207639b9bf12bb3791197af6dc9ad82608057446519efea8a2e8b5059d"} Sep 11 02:47:19.289715 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:19.289667 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4pjvl" podStartSLOduration=66.241421919 podStartE2EDuration="1m12.289648339s" totalImagesPullingTime="6.04822642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:19.288974852 +0000 UTC m=+72.931309182" watchObservedRunningTime="2026-09-11 02:47:19.289648339 +0000 UTC m=+72.931982669" Sep 11 02:47:21.287581 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:21.287535 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" event={"ID":"0c627a6a-9156-451b-a30f-198314adc348","Type":"ContainerStarted","Data":"d3589d4f99e64c982691e538ed9f257136a8e6a9e907a7cc758dc771a0f7e8f2"} Sep 11 02:47:21.288013 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:21.287601 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" event={"ID":"0c627a6a-9156-451b-a30f-198314adc348","Type":"ContainerStarted","Data":"07faec579d3e28dd2f5be03d35c71f9fd5fbb05ceb0ba3665e50a75f86c640f2"} Sep 11 02:47:21.307576 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:21.307522 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wj82r" podStartSLOduration=4.147488923 podStartE2EDuration="5.307498097s" totalImagesPullingTime="1.160009174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:21.30692017 +0000 UTC m=+74.949254503" watchObservedRunningTime="2026-09-11 02:47:21.307498097 +0000 UTC m=+74.949832424" Sep 11 02:47:21.307832 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:21.307791 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g8p6h" podStartSLOduration=68.589670526 podStartE2EDuration="1m14.307782023s" totalImagesPullingTime="5.718111497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:19.309230514 +0000 UTC m=+72.951564845" watchObservedRunningTime="2026-09-11 02:47:21.307782023 +0000 UTC m=+74.950116360" Sep 11 02:47:22.936913 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.936879 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:47:22.939710 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.939684 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.943094 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.943074 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 11 02:47:22.943211 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.943116 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 11 02:47:22.944547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.944349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 11 02:47:22.944547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.944356 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 11 02:47:22.944547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.944386 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 11 02:47:22.944547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.944476 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-85fbd\"" Sep 11 02:47:22.955547 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.955514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:47:22.991155 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.991335 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.991335 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.991335 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991230 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.991335 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:22.991335 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:22.991287 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm658\" (UniqueName: \"kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092549 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092549 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm658\" (UniqueName: \"kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092711 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.092794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.092738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.093579 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.093504 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.093579 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.093555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.093755 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.093635 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.095493 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.095471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.095619 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.095553 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.106770 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.106745 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm658\" (UniqueName: \"kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658\") pod \"console-6c94699fc-qjf49\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.250690 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.250608 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:23.274622 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.274592 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm"] Sep 11 02:47:23.276808 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.276789 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.282955 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.282933 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 11 02:47:23.285253 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.284885 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zlbq8"] Sep 11 02:47:23.285546 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.285522 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 11 02:47:23.287305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.287280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.288508 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.288488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 11 02:47:23.289100 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.289073 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g72mg\"" Sep 11 02:47:23.290567 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.290514 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 02:47:23.290675 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.290637 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dtdzg\"" Sep 11 02:47:23.290836 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.290822 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 02:47:23.292005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.291989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 02:47:23.293763 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.293763 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd28ac26-942c-4e1f-b577-d96c6ba584f7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.293918 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-root\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.293918 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-metrics-client-ca\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.293918 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-wtmp\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.293918 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.294136 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.293941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqq86\" (UniqueName: \"kubernetes.io/projected/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-api-access-kqq86\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.294136 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-tls\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.294136 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-sys\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.294136 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294092 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.294136 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.294390 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294174 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.294390 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-textfile\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.294390 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.294390 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.294284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvr9\" (UniqueName: \"kubernetes.io/projected/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-kube-api-access-hlvr9\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.298714 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.298695 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm"] Sep 11 02:47:23.395649 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.395816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqq86\" (UniqueName: \"kubernetes.io/projected/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-api-access-kqq86\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.395816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-tls\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.395816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-sys\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.395816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395786 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.395816 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-textfile\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-sys\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:23.395989 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:23.396050 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls podName:bd28ac26-942c-4e1f-b577-d96c6ba584f7 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:23.896028456 +0000 UTC m=+77.538362763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-j6pjm" (UID: "bd28ac26-942c-4e1f-b577-d96c6ba584f7") : secret "kube-state-metrics-tls" not found Sep 11 02:47:23.396074 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.395903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvr9\" (UniqueName: \"kubernetes.io/projected/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-kube-api-access-hlvr9\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd28ac26-942c-4e1f-b577-d96c6ba584f7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-root\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-metrics-client-ca\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-wtmp\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396467 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-wtmp\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396657 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-root\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.396794 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.397004 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd28ac26-942c-4e1f-b577-d96c6ba584f7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.397074 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-textfile\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.397119 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.397237 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.397157 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-metrics-client-ca\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.398067 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.397250 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.398946 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.398914 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.399117 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.399097 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-tls\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.399238 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.399219 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.407849 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.407831 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqq86\" (UniqueName: \"kubernetes.io/projected/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-api-access-kqq86\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.407925 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.407860 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvr9\" (UniqueName: \"kubernetes.io/projected/4153e8e0-a9e2-4776-8f42-2efbe90b19a4-kube-api-access-hlvr9\") pod \"node-exporter-zlbq8\" (UID: \"4153e8e0-a9e2-4776-8f42-2efbe90b19a4\") " pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.597551 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.597466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlbq8" Sep 11 02:47:23.899631 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:23.899592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:23.899809 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:23.899770 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 11 02:47:23.899879 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:23.899853 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls podName:bd28ac26-942c-4e1f-b577-d96c6ba584f7 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:24.899832049 +0000 UTC m=+78.542166375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-j6pjm" (UID: "bd28ac26-942c-4e1f-b577-d96c6ba584f7") : secret "kube-state-metrics-tls" not found Sep 11 02:47:24.315970 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.315892 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:47:24.319737 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.319711 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.323064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323042 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 02:47:24.323171 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323073 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 02:47:24.323171 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323073 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 02:47:24.323171 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323117 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 02:47:24.323171 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323042 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 02:47:24.323453 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323437 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 02:47:24.323512 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323479 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 02:47:24.323803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323788 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 02:47:24.323890 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.323839 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 02:47:24.324084 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.324069 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rg2kw\"" Sep 11 02:47:24.339847 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.339768 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:47:24.404249 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxn64\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404249 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404520 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404275 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404520 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404520 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404520 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404464 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404520 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404725 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404725 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404725 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404725 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404725 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404697 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.404870 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.404726 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.505875 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.505836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.505906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.505951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxn64\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.505981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506056 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506105 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.506245 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.507570 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.506719 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.507570 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.507149 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.509048 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.509018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.509196 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.509175 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.509323 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:24.509309 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle podName:1776e60c-65ee-476f-8e23-d4fa9f62d95b nodeName:}" failed. No retries permitted until 2026-09-11 02:47:25.00928922 +0000 UTC m=+78.651623551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b") : configmap references non-existent config key: ca-bundle.crt Sep 11 02:47:24.510095 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.510050 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.510518 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.510478 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.510767 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.510743 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.511193 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.511151 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.511739 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.511722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.511812 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.511769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.511812 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.511776 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.515100 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.515083 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxn64\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:24.909946 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.909903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:24.912767 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:24.912738 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd28ac26-942c-4e1f-b577-d96c6ba584f7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-j6pjm\" (UID: \"bd28ac26-942c-4e1f-b577-d96c6ba584f7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:25.011795 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:25.011751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:25.012756 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:25.012735 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:25.088729 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:25.088691 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" Sep 11 02:47:25.231737 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:25.231631 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:47:26.209972 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.209935 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b5fc847-zqqv6"] Sep 11 02:47:26.212990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.212962 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.215803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.215781 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 11 02:47:26.215909 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.215848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 11 02:47:26.215909 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.215882 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wdmz9\"" Sep 11 02:47:26.215995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.215848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 11 02:47:26.215995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.215888 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 11 02:47:26.216072 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.216028 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7k6ssfjvkh3n0\"" Sep 11 02:47:26.216072 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.216041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 11 02:47:26.223621 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223750 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-grpc-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223750 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223750 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223867 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223867 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2cff2d-fad3-4849-aed0-d35aea621bdd-metrics-client-ca\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223952 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvx8f\" (UniqueName: \"kubernetes.io/projected/ae2cff2d-fad3-4849-aed0-d35aea621bdd-kube-api-access-xvx8f\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.223952 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.223914 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.226579 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.226551 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5fc847-zqqv6"] Sep 11 02:47:26.324782 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.324978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.324978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.324978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2cff2d-fad3-4849-aed0-d35aea621bdd-metrics-client-ca\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.324978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvx8f\" (UniqueName: \"kubernetes.io/projected/ae2cff2d-fad3-4849-aed0-d35aea621bdd-kube-api-access-xvx8f\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.324978 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.325220 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.324984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.325220 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.325021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-grpc-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.325976 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.325912 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2cff2d-fad3-4849-aed0-d35aea621bdd-metrics-client-ca\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.327958 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.327912 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.328332 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.328312 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.328473 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.328450 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-grpc-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.328542 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.328488 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.328599 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.328544 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-tls\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.328997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.328972 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae2cff2d-fad3-4849-aed0-d35aea621bdd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.335518 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.335496 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvx8f\" (UniqueName: \"kubernetes.io/projected/ae2cff2d-fad3-4849-aed0-d35aea621bdd-kube-api-access-xvx8f\") pod \"thanos-querier-86b5fc847-zqqv6\" (UID: \"ae2cff2d-fad3-4849-aed0-d35aea621bdd\") " pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:26.524748 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:26.524660 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:27.721071 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.720934 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66898ddf98-qnzsz"] Sep 11 02:47:27.723887 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.723855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.726440 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.726419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8x927\"" Sep 11 02:47:27.727450 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.727377 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 11 02:47:27.727450 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.727431 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 11 02:47:27.727615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.727603 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 11 02:47:27.727868 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.727842 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 02:47:27.727979 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.727961 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-gkknga66qcek\"" Sep 11 02:47:27.735013 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.734990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66898ddf98-qnzsz"] Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-tls\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-client-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-metrics-server-audit-profiles\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835298 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq7rv\" (UniqueName: \"kubernetes.io/projected/d602ac9f-6796-4ed5-b507-3a48a001097b-kube-api-access-zq7rv\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d602ac9f-6796-4ed5-b507-3a48a001097b-audit-log\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.835472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.835386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-client-certs\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936423 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-client-certs\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936445 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-tls\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-client-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-metrics-server-audit-profiles\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq7rv\" (UniqueName: \"kubernetes.io/projected/d602ac9f-6796-4ed5-b507-3a48a001097b-kube-api-access-zq7rv\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936793 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d602ac9f-6796-4ed5-b507-3a48a001097b-audit-log\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.936989 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.936967 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d602ac9f-6796-4ed5-b507-3a48a001097b-audit-log\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.938065 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.938035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.938279 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.938261 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d602ac9f-6796-4ed5-b507-3a48a001097b-metrics-server-audit-profiles\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.940489 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.940459 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-client-certs\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.940757 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.940739 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-secret-metrics-server-tls\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.941057 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.941040 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d602ac9f-6796-4ed5-b507-3a48a001097b-client-ca-bundle\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.949761 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.949735 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq7rv\" (UniqueName: \"kubernetes.io/projected/d602ac9f-6796-4ed5-b507-3a48a001097b-kube-api-access-zq7rv\") pod \"metrics-server-66898ddf98-qnzsz\" (UID: \"d602ac9f-6796-4ed5-b507-3a48a001097b\") " pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:27.971748 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.971667 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl"] Sep 11 02:47:27.974894 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.974863 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:27.977705 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.977680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 11 02:47:27.977856 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.977717 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qf42g\"" Sep 11 02:47:27.985806 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:27.985777 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl"] Sep 11 02:47:28.035033 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.035000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:28.037045 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.037013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.037172 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.037066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9gv\" (UniqueName: \"kubernetes.io/projected/8f764bb6-05b4-45d2-8db5-edb33e248783-kube-api-access-kj9gv\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.138498 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.138460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.138677 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.138514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9gv\" (UniqueName: \"kubernetes.io/projected/8f764bb6-05b4-45d2-8db5-edb33e248783-kube-api-access-kj9gv\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.138677 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:28.138614 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 11 02:47:28.138790 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:47:28.138694 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert podName:8f764bb6-05b4-45d2-8db5-edb33e248783 nodeName:}" failed. No retries permitted until 2026-09-11 02:47:28.63867602 +0000 UTC m=+82.281010347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-zhjtl" (UID: "8f764bb6-05b4-45d2-8db5-edb33e248783") : secret "monitoring-plugin-cert" not found Sep 11 02:47:28.150748 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.150721 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9gv\" (UniqueName: \"kubernetes.io/projected/8f764bb6-05b4-45d2-8db5-edb33e248783-kube-api-access-kj9gv\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.641987 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.641956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.644731 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.644701 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f764bb6-05b4-45d2-8db5-edb33e248783-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zhjtl\" (UID: \"8f764bb6-05b4-45d2-8db5-edb33e248783\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:28.887796 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:28.887725 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:29.445823 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.445781 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:47:29.453746 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.453718 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.456611 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.456586 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 02:47:29.456742 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.456701 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5fzk4\"" Sep 11 02:47:29.456805 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.456787 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 02:47:29.456916 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.456897 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 02:47:29.457036 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.456986 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 02:47:29.457124 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.457110 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 02:47:29.457994 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.457966 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 02:47:29.458103 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.458057 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 02:47:29.458184 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.458160 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 02:47:29.458239 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.458194 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 02:47:29.458599 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.458579 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 02:47:29.459432 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.459249 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 02:47:29.459668 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.459643 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 02:47:29.459931 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.459910 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7jkobqnh543rj\"" Sep 11 02:47:29.460077 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.460063 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 02:47:29.460595 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.460574 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 02:47:29.474701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.474674 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:47:29.549412 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549412 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549415 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549634 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549634 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549634 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549634 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549810 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549675 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549810 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549810 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549954 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549954 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549954 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549954 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.549954 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.549972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.550006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.550056 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggsr\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.550112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550175 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.550151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.550387 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.550177 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650745 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650706 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650745 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650788 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggsr\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.650985 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650955 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.650991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651140 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651344 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.651863 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.651533 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.653552 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.652849 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.653552 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.652887 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.653552 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.652992 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.653920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.653891 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.653983 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.653948 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.654927 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.654759 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.657472 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.657449 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.659181 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.658820 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.659376 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.659289 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.659476 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.659415 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.659552 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.659481 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.660225 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.660188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.660486 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.660444 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.660630 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.660607 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.661560 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.661538 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggsr\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.662031 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.661990 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.662366 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.662344 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.662602 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.662585 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.663082 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.663059 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:29.777100 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:29.776997 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:30.324577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.324501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbq8" event={"ID":"4153e8e0-a9e2-4776-8f42-2efbe90b19a4","Type":"ContainerStarted","Data":"4dc402a71c715d64984588bb72fcdf7bc95f3dc2cd74c2f396bbf27f4ad0dc28"} Sep 11 02:47:30.346074 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.346043 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm"] Sep 11 02:47:30.350614 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.350563 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66898ddf98-qnzsz"] Sep 11 02:47:30.352817 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.352789 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl"] Sep 11 02:47:30.358932 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.358706 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:47:30.371617 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.371562 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:47:30.379972 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.379948 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:47:30.401583 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:30.401561 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5fc847-zqqv6"] Sep 11 02:47:30.433157 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.433133 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd28ac26_942c_4e1f_b577_d96c6ba584f7.slice/crio-8be139b3525d19ecf87248ae1647325ec9f2c21ac20aeeaa2156c65394d1d613 WatchSource:0}: Error finding container 8be139b3525d19ecf87248ae1647325ec9f2c21ac20aeeaa2156c65394d1d613: Status 404 returned error can't find the container with id 8be139b3525d19ecf87248ae1647325ec9f2c21ac20aeeaa2156c65394d1d613 Sep 11 02:47:30.433924 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.433867 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd602ac9f_6796_4ed5_b507_3a48a001097b.slice/crio-f5de02fae04110e86fcef6e73b2ba6452c3d0d3120a3e8b72588a5c09fb4ef7f WatchSource:0}: Error finding container f5de02fae04110e86fcef6e73b2ba6452c3d0d3120a3e8b72588a5c09fb4ef7f: Status 404 returned error can't find the container with id f5de02fae04110e86fcef6e73b2ba6452c3d0d3120a3e8b72588a5c09fb4ef7f Sep 11 02:47:30.434696 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.434672 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f764bb6_05b4_45d2_8db5_edb33e248783.slice/crio-ac54774abe402852884e96576dffa6f72f3d8dd61b44c78d6b55a17340cc7f92 WatchSource:0}: Error finding container ac54774abe402852884e96576dffa6f72f3d8dd61b44c78d6b55a17340cc7f92: Status 404 returned error can't find the container with id ac54774abe402852884e96576dffa6f72f3d8dd61b44c78d6b55a17340cc7f92 Sep 11 02:47:30.435827 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.435768 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1776e60c_65ee_476f_8e23_d4fa9f62d95b.slice/crio-23d0db18133b5cfb21f63efc193bb4591d4c8fccb4914a63ec83a542b9599175 WatchSource:0}: Error finding container 23d0db18133b5cfb21f63efc193bb4591d4c8fccb4914a63ec83a542b9599175: Status 404 returned error can't find the container with id 23d0db18133b5cfb21f63efc193bb4591d4c8fccb4914a63ec83a542b9599175 Sep 11 02:47:30.436528 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.436502 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bef6ce7_b9da_414e_8162_1ec7741ef70d.slice/crio-6af0a1f2acf7520db55ce84051e8dacc2f8d845ee3816dd36ddb5834e1dd34e3 WatchSource:0}: Error finding container 6af0a1f2acf7520db55ce84051e8dacc2f8d845ee3816dd36ddb5834e1dd34e3: Status 404 returned error can't find the container with id 6af0a1f2acf7520db55ce84051e8dacc2f8d845ee3816dd36ddb5834e1dd34e3 Sep 11 02:47:30.437670 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.437491 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0d6194_cfae_4544_ac97_2aac95f66030.slice/crio-13876b2be4659a75b8e7d2cae0bffffa54ff967cac6530465252779a7d5a71a0 WatchSource:0}: Error finding container 13876b2be4659a75b8e7d2cae0bffffa54ff967cac6530465252779a7d5a71a0: Status 404 returned error can't find the container with id 13876b2be4659a75b8e7d2cae0bffffa54ff967cac6530465252779a7d5a71a0 Sep 11 02:47:30.438934 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:47:30.438682 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2cff2d_fad3_4849_aed0_d35aea621bdd.slice/crio-10a11385f737a742a8e93a9357e1ef912984b6e212fea29e820a7692445dba70 WatchSource:0}: Error finding container 10a11385f737a742a8e93a9357e1ef912984b6e212fea29e820a7692445dba70: Status 404 returned error can't find the container with id 10a11385f737a742a8e93a9357e1ef912984b6e212fea29e820a7692445dba70 Sep 11 02:47:31.337060 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.336971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94699fc-qjf49" event={"ID":"7bef6ce7-b9da-414e-8162-1ec7741ef70d","Type":"ContainerStarted","Data":"6af0a1f2acf7520db55ce84051e8dacc2f8d845ee3816dd36ddb5834e1dd34e3"} Sep 11 02:47:31.339659 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.339623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"13876b2be4659a75b8e7d2cae0bffffa54ff967cac6530465252779a7d5a71a0"} Sep 11 02:47:31.346452 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.346420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" event={"ID":"bd28ac26-942c-4e1f-b577-d96c6ba584f7","Type":"ContainerStarted","Data":"8be139b3525d19ecf87248ae1647325ec9f2c21ac20aeeaa2156c65394d1d613"} Sep 11 02:47:31.349992 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.349873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" event={"ID":"8f764bb6-05b4-45d2-8db5-edb33e248783","Type":"ContainerStarted","Data":"ac54774abe402852884e96576dffa6f72f3d8dd61b44c78d6b55a17340cc7f92"} Sep 11 02:47:31.354442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.354413 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-khhcg" event={"ID":"936c815e-4056-4baa-accf-3f0285f8d44e","Type":"ContainerStarted","Data":"c2e105839764bda56551e66fbb881633653735e3319111cb7cf561cccc50e0c5"} Sep 11 02:47:31.355521 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.355447 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:31.358764 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.358644 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"10a11385f737a742a8e93a9357e1ef912984b6e212fea29e820a7692445dba70"} Sep 11 02:47:31.361016 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.360984 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"23d0db18133b5cfb21f63efc193bb4591d4c8fccb4914a63ec83a542b9599175"} Sep 11 02:47:31.363892 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.363839 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" event={"ID":"d602ac9f-6796-4ed5-b507-3a48a001097b","Type":"ContainerStarted","Data":"f5de02fae04110e86fcef6e73b2ba6452c3d0d3120a3e8b72588a5c09fb4ef7f"} Sep 11 02:47:31.368552 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.368524 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-khhcg" Sep 11 02:47:31.374308 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:31.374247 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-khhcg" podStartSLOduration=2.094096493 podStartE2EDuration="20.374228135s" totalImagesPullingTime="18.280131642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:31.37186623 +0000 UTC m=+85.014200560" watchObservedRunningTime="2026-09-11 02:47:31.374228135 +0000 UTC m=+85.016562465" Sep 11 02:47:32.401856 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:32.401823 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbq8" event={"ID":"4153e8e0-a9e2-4776-8f42-2efbe90b19a4","Type":"ContainerStarted","Data":"87294639a2c50c9bef8fc09b92791c0327e1b187170dc613dd3b94c8e3f1f466"} Sep 11 02:47:33.419032 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:33.417682 2557 generic.go:356] "Generic (PLEG): container finished" podID="4153e8e0-a9e2-4776-8f42-2efbe90b19a4" containerID="87294639a2c50c9bef8fc09b92791c0327e1b187170dc613dd3b94c8e3f1f466" exitCode=0 Sep 11 02:47:33.419032 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:33.418799 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbq8" event={"ID":"4153e8e0-a9e2-4776-8f42-2efbe90b19a4","Type":"ContainerDied","Data":"87294639a2c50c9bef8fc09b92791c0327e1b187170dc613dd3b94c8e3f1f466"} Sep 11 02:47:39.451325 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.451280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94699fc-qjf49" event={"ID":"7bef6ce7-b9da-414e-8162-1ec7741ef70d","Type":"ContainerStarted","Data":"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80"} Sep 11 02:47:39.452852 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.452826 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" exitCode=0 Sep 11 02:47:39.452967 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.452907 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} Sep 11 02:47:39.455140 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.455108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" event={"ID":"bd28ac26-942c-4e1f-b577-d96c6ba584f7","Type":"ContainerStarted","Data":"e34047dd8bd802b62ba6c1df7cbb2b7b595e05b98d9362b55bd3befdc33de8ca"} Sep 11 02:47:39.455238 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.455168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" event={"ID":"bd28ac26-942c-4e1f-b577-d96c6ba584f7","Type":"ContainerStarted","Data":"d0e0c37f245c4868e76b03164e2485fcbbf8435dd2a3cbc22bc1bf3f7b269ddc"} Sep 11 02:47:39.455238 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.455199 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" event={"ID":"bd28ac26-942c-4e1f-b577-d96c6ba584f7","Type":"ContainerStarted","Data":"164a990f49c7bee337fb1e1df73c101942dfc0b3b72601f763c49a20c131c52b"} Sep 11 02:47:39.457393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.457368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbq8" event={"ID":"4153e8e0-a9e2-4776-8f42-2efbe90b19a4","Type":"ContainerStarted","Data":"95080d9e44c75c2977dfc098d46764e2916783e2b9c1209152205980b42a4b2b"} Sep 11 02:47:39.457498 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.457433 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbq8" event={"ID":"4153e8e0-a9e2-4776-8f42-2efbe90b19a4","Type":"ContainerStarted","Data":"b9900f0fa8b49cf2966d1f5b090a37c60f4b3d1167e5b0243484233450e96d27"} Sep 11 02:47:39.458709 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.458690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" event={"ID":"8f764bb6-05b4-45d2-8db5-edb33e248783","Type":"ContainerStarted","Data":"d5001d08361d91880dae672d45de876f8f2696fea77b2160b8834a58b4c111c0"} Sep 11 02:47:39.458905 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.458870 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:39.461048 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.461017 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"923f7a85e9a67b392f88ca984ff570c9c600c04aa5f32e0c060a9c9d9b984f4a"} Sep 11 02:47:39.461148 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.461081 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"88375e67aa2da6ce8eba86f5a83b21560942bb48744723ce292370a3c69da735"} Sep 11 02:47:39.461148 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.461126 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"8db99eb38e0f6927ecf47c864428781fdafb2815874d1caa6f197d397452773d"} Sep 11 02:47:39.462538 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.462520 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6" exitCode=0 Sep 11 02:47:39.462643 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.462579 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6"} Sep 11 02:47:39.464500 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.464479 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" event={"ID":"d602ac9f-6796-4ed5-b507-3a48a001097b","Type":"ContainerStarted","Data":"5e511604a854763f6880b20907fbdc7536f3406cc007f9e8710162f847d0fc25"} Sep 11 02:47:39.464617 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.464602 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" Sep 11 02:47:39.484176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.484134 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c94699fc-qjf49" podStartSLOduration=9.519575293 podStartE2EDuration="17.484118748s" totalImagesPullingTime="7.964543455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:39.468047894 +0000 UTC m=+93.110382234" watchObservedRunningTime="2026-09-11 02:47:39.484118748 +0000 UTC m=+93.126453077" Sep 11 02:47:39.484350 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.484222 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-j6pjm" podStartSLOduration=8.792329957 podStartE2EDuration="16.484217845s" totalImagesPullingTime="7.691887888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:39.483519057 +0000 UTC m=+93.125853388" watchObservedRunningTime="2026-09-11 02:47:39.484217845 +0000 UTC m=+93.126552199" Sep 11 02:47:39.500666 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.500610 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zlbq8" podStartSLOduration=14.537245398 podStartE2EDuration="16.50059502s" totalImagesPullingTime="1.837126144s" totalInitContainerRuntime="126.223478ms" isStatefulPod=true podCreationTimestamp="2026-09-11 02:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:39.500171396 +0000 UTC m=+93.142505727" watchObservedRunningTime="2026-09-11 02:47:39.50059502 +0000 UTC m=+93.142929386" Sep 11 02:47:39.547585 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.547525 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" podStartSLOduration=4.832380487 podStartE2EDuration="12.547504262s" totalImagesPullingTime="7.715123775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:39.516913832 +0000 UTC m=+93.159248163" watchObservedRunningTime="2026-09-11 02:47:39.547504262 +0000 UTC m=+93.189838582" Sep 11 02:47:39.591045 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:39.591000 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zhjtl" podStartSLOduration=4.876277539 podStartE2EDuration="12.590980447s" totalImagesPullingTime="7.714702908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:39.590153522 +0000 UTC m=+93.232487853" watchObservedRunningTime="2026-09-11 02:47:39.590980447 +0000 UTC m=+93.233314777" Sep 11 02:47:40.474716 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:40.474302 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"1e5eaa3b7c4f074b52cab73674508fb7a02fb70b454b73e0a5487cced0bd4a0f"} Sep 11 02:47:40.523453 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:40.523355 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fzvl9_8f4dd375-455a-48c5-bc69-a96d8b5af794/serve-healthcheck-canary/0.log" Sep 11 02:47:41.484046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:41.483463 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"9ca6a84f7e4dea56e7c06733ddd5856f4bf7f33541ed42ae0c1dccecc4caca6c"} Sep 11 02:47:41.484046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:41.483587 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" event={"ID":"ae2cff2d-fad3-4849-aed0-d35aea621bdd","Type":"ContainerStarted","Data":"300d2bcd9577c256419fce6db5c3049237c26ee01141c7f45c2044fd4593dd4f"} Sep 11 02:47:41.484046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:41.483807 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:41.509808 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:41.509756 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" podStartSLOduration=6.484414759 podStartE2EDuration="15.509735645s" totalImagesPullingTime="9.025320886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:41.509285444 +0000 UTC m=+95.151619774" watchObservedRunningTime="2026-09-11 02:47:41.509735645 +0000 UTC m=+95.152069975" Sep 11 02:47:43.251639 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:43.251607 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:43.251987 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:43.251676 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:43.256458 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:43.256434 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:43.493765 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:43.493736 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43"} Sep 11 02:47:43.497909 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:43.497878 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:47:44.078414 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.078374 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:47:44.501778 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} Sep 11 02:47:44.502267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} Sep 11 02:47:44.502267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} Sep 11 02:47:44.502267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} Sep 11 02:47:44.502267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501950 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} Sep 11 02:47:44.502267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.501973 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerStarted","Data":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} Sep 11 02:47:44.505134 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.505104 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e"} Sep 11 02:47:44.505278 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.505182 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76"} Sep 11 02:47:44.505278 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.505231 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b"} Sep 11 02:47:44.505278 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.505268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab"} Sep 11 02:47:44.505466 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.505314 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerStarted","Data":"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58"} Sep 11 02:47:44.571797 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.571740 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.797764608 podStartE2EDuration="15.571724323s" totalImagesPullingTime="11.726411332s" totalInitContainerRuntime="47.548383ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:44.569145611 +0000 UTC m=+98.211479941" watchObservedRunningTime="2026-09-11 02:47:44.571724323 +0000 UTC m=+98.214058652" Sep 11 02:47:44.609537 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.609493 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.165349195 podStartE2EDuration="20.60947762s" totalImagesPullingTime="11.394099721s" totalInitContainerRuntime="50.028704ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:47:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:47:44.606416938 +0000 UTC m=+98.248751258" watchObservedRunningTime="2026-09-11 02:47:44.60947762 +0000 UTC m=+98.251811958" Sep 11 02:47:44.777338 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:44.777251 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:47:47.493790 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:47.493763 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b5fc847-zqqv6" Sep 11 02:47:48.035382 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:48.035344 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:48.035649 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:48.035421 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:47:50.285261 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:47:50.285224 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g8p6h" Sep 11 02:48:08.041329 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:08.041300 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:48:08.045261 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:08.045244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66898ddf98-qnzsz" Sep 11 02:48:10.529419 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.529373 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c94699fc-qjf49" podUID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" containerName="console" containerID="cri-o://deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80" gracePeriod=15 Sep 11 02:48:10.802257 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.802190 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:48:10.830957 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.830933 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831085 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.830964 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm658\" (UniqueName: \"kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831085 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831014 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831085 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831057 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831126 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831177 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config\") pod \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\" (UID: \"7bef6ce7-b9da-414e-8162-1ec7741ef70d\") " Sep 11 02:48:10.831525 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831496 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config" (OuterVolumeSpecName: "console-config") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:10.831771 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831522 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:10.831771 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.831603 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca" (OuterVolumeSpecName: "service-ca") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:10.833392 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.833357 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658" (OuterVolumeSpecName: "kube-api-access-qm658") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "kube-api-access-qm658". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:48:10.833392 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.833385 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:10.833541 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.833460 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7bef6ce7-b9da-414e-8162-1ec7741ef70d" (UID: "7bef6ce7-b9da-414e-8162-1ec7741ef70d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:10.931920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931884 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-service-ca\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:10.931920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931914 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-oauth-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:10.931920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931924 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-serving-cert\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:10.932137 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931934 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm658\" (UniqueName: \"kubernetes.io/projected/7bef6ce7-b9da-414e-8162-1ec7741ef70d-kube-api-access-qm658\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:10.932137 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931943 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-console-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:10.932137 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:10.931951 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ce7-b9da-414e-8162-1ec7741ef70d-oauth-serving-cert\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:11.639360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.639322 2557 generic.go:356] "Generic (PLEG): container finished" podID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" containerID="deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80" exitCode=0 Sep 11 02:48:11.639360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.639365 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94699fc-qjf49" Sep 11 02:48:11.639883 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.639427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94699fc-qjf49" event={"ID":"7bef6ce7-b9da-414e-8162-1ec7741ef70d","Type":"ContainerDied","Data":"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80"} Sep 11 02:48:11.639883 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.639478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94699fc-qjf49" event={"ID":"7bef6ce7-b9da-414e-8162-1ec7741ef70d","Type":"ContainerDied","Data":"6af0a1f2acf7520db55ce84051e8dacc2f8d845ee3816dd36ddb5834e1dd34e3"} Sep 11 02:48:11.639883 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.639499 2557 scope.go:117] "RemoveContainer" containerID="deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80" Sep 11 02:48:11.647681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.647667 2557 scope.go:117] "RemoveContainer" containerID="deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80" Sep 11 02:48:11.647927 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:11.647908 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80\": container with ID starting with deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80 not found: ID does not exist" containerID="deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80" Sep 11 02:48:11.647968 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.647936 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80"} err="failed to get container status \"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80\": rpc error: code = NotFound desc = could not find container \"deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80\": container with ID starting with deaa624670c4b40a91ef23aa041d21edb712e1db654541d60cd4fb15bfda6f80 not found: ID does not exist" Sep 11 02:48:11.655888 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.655867 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:48:11.659533 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:11.659511 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c94699fc-qjf49"] Sep 11 02:48:12.841117 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:12.841076 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" path="/var/lib/kubelet/pods/7bef6ce7-b9da-414e-8162-1ec7741ef70d/volumes" Sep 11 02:48:29.777962 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:29.777920 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:29.798090 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:29.798065 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:30.732058 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:30.732030 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:43.493351 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493316 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:43.493830 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493649 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="alertmanager" containerID="cri-o://4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43" gracePeriod=120 Sep 11 02:48:43.493830 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493710 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-metric" containerID="cri-o://ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76" gracePeriod=120 Sep 11 02:48:43.493830 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493761 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-web" containerID="cri-o://a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab" gracePeriod=120 Sep 11 02:48:43.493830 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493798 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy" containerID="cri-o://379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b" gracePeriod=120 Sep 11 02:48:43.493830 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493800 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="config-reloader" containerID="cri-o://f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58" gracePeriod=120 Sep 11 02:48:43.494064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.493823 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="prom-label-proxy" containerID="cri-o://fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e" gracePeriod=120 Sep 11 02:48:43.769800 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769725 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e" exitCode=0 Sep 11 02:48:43.769800 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769749 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76" exitCode=0 Sep 11 02:48:43.769800 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769755 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b" exitCode=0 Sep 11 02:48:43.769800 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769761 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58" exitCode=0 Sep 11 02:48:43.769800 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769766 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43" exitCode=0 Sep 11 02:48:43.770044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769797 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e"} Sep 11 02:48:43.770044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76"} Sep 11 02:48:43.770044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b"} Sep 11 02:48:43.770044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769910 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58"} Sep 11 02:48:43.770044 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:43.769934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43"} Sep 11 02:48:44.734025 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.734000 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:44.780750 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.780720 2557 generic.go:356] "Generic (PLEG): container finished" podID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerID="a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab" exitCode=0 Sep 11 02:48:44.780920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.780773 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab"} Sep 11 02:48:44.780920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.780849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1776e60c-65ee-476f-8e23-d4fa9f62d95b","Type":"ContainerDied","Data":"23d0db18133b5cfb21f63efc193bb4591d4c8fccb4914a63ec83a542b9599175"} Sep 11 02:48:44.780920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.780866 2557 scope.go:117] "RemoveContainer" containerID="fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e" Sep 11 02:48:44.780920 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.780849 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:44.789604 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.789584 2557 scope.go:117] "RemoveContainer" containerID="ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76" Sep 11 02:48:44.796916 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.796877 2557 scope.go:117] "RemoveContainer" containerID="379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b" Sep 11 02:48:44.804446 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.804428 2557 scope.go:117] "RemoveContainer" containerID="a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab" Sep 11 02:48:44.811092 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811069 2557 scope.go:117] "RemoveContainer" containerID="f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58" Sep 11 02:48:44.811250 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811231 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811353 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811257 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811353 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811279 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811353 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811300 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811353 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811341 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811369 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811427 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811462 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811501 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811554 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811582 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxn64\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811609 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811605 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:48:44.811681 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811655 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls\") pod \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\" (UID: \"1776e60c-65ee-476f-8e23-d4fa9f62d95b\") " Sep 11 02:48:44.812105 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.811908 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-main-db\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.812200 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.812172 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:44.812373 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.812350 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:44.815845 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.815817 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:48:44.816157 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.816113 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out" (OuterVolumeSpecName: "config-out") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:48:44.816157 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.816123 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.816914 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.816872 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.817272 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.817237 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.817378 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.817304 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64" (OuterVolumeSpecName: "kube-api-access-dxn64") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "kube-api-access-dxn64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:48:44.817575 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.817540 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume" (OuterVolumeSpecName: "config-volume") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.817575 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.817394 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.821241 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.821216 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.827993 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.827968 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config" (OuterVolumeSpecName: "web-config") pod "1776e60c-65ee-476f-8e23-d4fa9f62d95b" (UID: "1776e60c-65ee-476f-8e23-d4fa9f62d95b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:44.834232 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.834212 2557 scope.go:117] "RemoveContainer" containerID="4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43" Sep 11 02:48:44.846169 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.846142 2557 scope.go:117] "RemoveContainer" containerID="eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6" Sep 11 02:48:44.853651 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.853636 2557 scope.go:117] "RemoveContainer" containerID="fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e" Sep 11 02:48:44.853926 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.853908 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e\": container with ID starting with fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e not found: ID does not exist" containerID="fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e" Sep 11 02:48:44.853977 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.853935 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e"} err="failed to get container status \"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e\": rpc error: code = NotFound desc = could not find container \"fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e\": container with ID starting with fbc5f40c88312c5ae54955c410169f9a4a50ffc5737e51737e56c61932ae813e not found: ID does not exist" Sep 11 02:48:44.853977 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.853952 2557 scope.go:117] "RemoveContainer" containerID="ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76" Sep 11 02:48:44.854226 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.854208 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76\": container with ID starting with ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76 not found: ID does not exist" containerID="ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76" Sep 11 02:48:44.854274 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854232 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76"} err="failed to get container status \"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76\": rpc error: code = NotFound desc = could not find container \"ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76\": container with ID starting with ee9eb2d8dac4348b3623a90bfac490c77310f57ad6bf6b709e06b1cc2fe22f76 not found: ID does not exist" Sep 11 02:48:44.854274 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854248 2557 scope.go:117] "RemoveContainer" containerID="379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b" Sep 11 02:48:44.854506 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.854491 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b\": container with ID starting with 379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b not found: ID does not exist" containerID="379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b" Sep 11 02:48:44.854557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854508 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b"} err="failed to get container status \"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b\": rpc error: code = NotFound desc = could not find container \"379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b\": container with ID starting with 379c0b26d894e52f812b5de7fc6ccc4a26bcbab4ddf1c29ca7a243a2bc78944b not found: ID does not exist" Sep 11 02:48:44.854557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854521 2557 scope.go:117] "RemoveContainer" containerID="a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab" Sep 11 02:48:44.854758 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.854743 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab\": container with ID starting with a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab not found: ID does not exist" containerID="a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab" Sep 11 02:48:44.854803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854762 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab"} err="failed to get container status \"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab\": rpc error: code = NotFound desc = could not find container \"a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab\": container with ID starting with a18c2b9c40adec4d66d300d93353cc4617b6a97e674799a7942b01e696ef47ab not found: ID does not exist" Sep 11 02:48:44.854803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854773 2557 scope.go:117] "RemoveContainer" containerID="f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58" Sep 11 02:48:44.854967 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.854954 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58\": container with ID starting with f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58 not found: ID does not exist" containerID="f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58" Sep 11 02:48:44.855004 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854969 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58"} err="failed to get container status \"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58\": rpc error: code = NotFound desc = could not find container \"f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58\": container with ID starting with f552b5039b07d57c0723539301c9e2ce0276fa68baa0381dc7ea072630db1e58 not found: ID does not exist" Sep 11 02:48:44.855004 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.854979 2557 scope.go:117] "RemoveContainer" containerID="4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43" Sep 11 02:48:44.855172 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.855158 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43\": container with ID starting with 4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43 not found: ID does not exist" containerID="4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43" Sep 11 02:48:44.855217 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.855172 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43"} err="failed to get container status \"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43\": rpc error: code = NotFound desc = could not find container \"4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43\": container with ID starting with 4b62c3e1984adce42191201c3c6d570953b506daad46e35598b5cdcceada5a43 not found: ID does not exist" Sep 11 02:48:44.855217 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.855182 2557 scope.go:117] "RemoveContainer" containerID="eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6" Sep 11 02:48:44.855368 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:44.855355 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6\": container with ID starting with eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6 not found: ID does not exist" containerID="eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6" Sep 11 02:48:44.855433 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.855369 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6"} err="failed to get container status \"eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6\": rpc error: code = NotFound desc = could not find container \"eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6\": container with ID starting with eae5766efcb8b5b975f46278f711a755e84fdba72b12b7ca3b9c23c37a2169b6 not found: ID does not exist" Sep 11 02:48:44.913199 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913163 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-metrics-client-ca\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913199 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913188 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxn64\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-kube-api-access-dxn64\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913199 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913197 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913199 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913207 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-main-tls\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913215 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-cluster-tls-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913224 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1776e60c-65ee-476f-8e23-d4fa9f62d95b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913233 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1776e60c-65ee-476f-8e23-d4fa9f62d95b-tls-assets\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913241 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-out\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913248 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-config-volume\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913256 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913265 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:44.913557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:44.913273 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1776e60c-65ee-476f-8e23-d4fa9f62d95b-web-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:45.098292 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.098221 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:45.102429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.102390 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:45.127023 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.126998 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:45.127347 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127334 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" containerName="console" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127350 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" containerName="console" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127361 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="init-config-reloader" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127370 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="init-config-reloader" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127382 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-metric" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127387 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-metric" Sep 11 02:48:45.127393 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127396 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127414 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127423 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="prom-label-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127428 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="prom-label-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127435 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-web" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127440 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-web" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127451 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="alertmanager" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127459 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="alertmanager" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127470 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="config-reloader" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127475 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="config-reloader" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127519 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-metric" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127527 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="prom-label-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127540 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127549 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="alertmanager" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127555 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bef6ce7-b9da-414e-8162-1ec7741ef70d" containerName="console" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127563 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="kube-rbac-proxy-web" Sep 11 02:48:45.127577 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.127569 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" containerName="config-reloader" Sep 11 02:48:45.131217 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.131200 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.133663 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.133646 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 02:48:45.133761 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.133690 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 02:48:45.133827 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.133791 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rg2kw\"" Sep 11 02:48:45.134023 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134009 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 02:48:45.134187 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134157 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 02:48:45.134305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134214 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 02:48:45.134305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134157 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 02:48:45.134305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134294 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 02:48:45.134487 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.134369 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 02:48:45.142440 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.142422 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 02:48:45.150000 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.149982 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:45.215361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215361 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215506 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clth\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-kube-api-access-2clth\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-config-out\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215589 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215577 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215879 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215879 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215879 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215639 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215879 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.215879 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.215811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-web-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317144 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317151 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clth\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-kube-api-access-2clth\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-config-out\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.317694 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.317506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-web-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.318325 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.318254 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.318473 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.318422 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320655 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320520 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-config-out\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320655 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320635 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320636 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320697 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-web-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320770 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320961 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320855 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.320961 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.320941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3a280a-c609-4d56-86c9-355ad2d57776-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.321051 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.321038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.321051 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.321045 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.322683 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.322663 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d3a280a-c609-4d56-86c9-355ad2d57776-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.325642 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.325622 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clth\" (UniqueName: \"kubernetes.io/projected/2d3a280a-c609-4d56-86c9-355ad2d57776-kube-api-access-2clth\") pod \"alertmanager-main-0\" (UID: \"2d3a280a-c609-4d56-86c9-355ad2d57776\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.439758 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.439729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:48:45.716876 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.716837 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:48:45.719236 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:48:45.719210 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3a280a_c609_4d56_86c9_355ad2d57776.slice/crio-c0749b97e7a9661576064ce48aee0cda67e1ab9c5a6274797b070e3af50b3383 WatchSource:0}: Error finding container c0749b97e7a9661576064ce48aee0cda67e1ab9c5a6274797b070e3af50b3383: Status 404 returned error can't find the container with id c0749b97e7a9661576064ce48aee0cda67e1ab9c5a6274797b070e3af50b3383 Sep 11 02:48:45.787032 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.787002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"bda70a68087db30b45da5b9669bf19650ad6708994122191a8f8535c307efda9"} Sep 11 02:48:45.787433 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:45.787064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"c0749b97e7a9661576064ce48aee0cda67e1ab9c5a6274797b070e3af50b3383"} Sep 11 02:48:46.792320 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:46.792286 2557 generic.go:356] "Generic (PLEG): container finished" podID="2d3a280a-c609-4d56-86c9-355ad2d57776" containerID="bda70a68087db30b45da5b9669bf19650ad6708994122191a8f8535c307efda9" exitCode=0 Sep 11 02:48:46.792320 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:46.792321 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerDied","Data":"bda70a68087db30b45da5b9669bf19650ad6708994122191a8f8535c307efda9"} Sep 11 02:48:46.841062 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:46.841033 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1776e60c-65ee-476f-8e23-d4fa9f62d95b" path="/var/lib/kubelet/pods/1776e60c-65ee-476f-8e23-d4fa9f62d95b/volumes" Sep 11 02:48:47.548485 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.548455 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f666f4955-xwxpp"] Sep 11 02:48:47.551151 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.551121 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.553776 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.553746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 11 02:48:47.553889 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.553746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 11 02:48:47.553889 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.553748 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 11 02:48:47.554077 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.554057 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l2fdz\"" Sep 11 02:48:47.554168 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.554150 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 11 02:48:47.554230 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.554180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 11 02:48:47.559269 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.559245 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 11 02:48:47.567649 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.567626 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f666f4955-xwxpp"] Sep 11 02:48:47.639144 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmslc\" (UniqueName: \"kubernetes.io/projected/205352a0-cc98-4fa1-be8a-d96fb77c85b7-kube-api-access-mmslc\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639357 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639357 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639357 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-federate-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639357 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639357 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639602 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-metrics-client-ca\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.639602 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.639421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.740861 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.740826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.740875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmslc\" (UniqueName: \"kubernetes.io/projected/205352a0-cc98-4fa1-be8a-d96fb77c85b7-kube-api-access-mmslc\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.740989 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741062 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-federate-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741159 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741159 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741252 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-metrics-client-ca\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.741761 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741710 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.742040 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741879 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.742040 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.741897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205352a0-cc98-4fa1-be8a-d96fb77c85b7-metrics-client-ca\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.743962 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.743937 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-telemeter-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.744134 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.744114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.744355 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.744332 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-secret-telemeter-client\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.744355 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.744349 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/205352a0-cc98-4fa1-be8a-d96fb77c85b7-federate-client-tls\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.748900 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.748870 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmslc\" (UniqueName: \"kubernetes.io/projected/205352a0-cc98-4fa1-be8a-d96fb77c85b7-kube-api-access-mmslc\") pod \"telemeter-client-5f666f4955-xwxpp\" (UID: \"205352a0-cc98-4fa1-be8a-d96fb77c85b7\") " pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:47.803029 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.802958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"6ab3b50831ceada3e40d59db0099d3a92ccb04d402fbd590955dd9396bcb0cab"} Sep 11 02:48:47.803029 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.803018 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"39281f16b206ee8f5a98b8eda3b22c892581193a69f976c9cd01f487f9311e67"} Sep 11 02:48:47.803442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.803043 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"9e9fe0765cf843aff1c7d76dbb80310eb32b6ffcf022a589512886f6e7d20037"} Sep 11 02:48:47.803442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.803069 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"5bb354e2e9ffde0dc5cb2e45cc19732aef67d17825f5344f028f39c05e97494c"} Sep 11 02:48:47.803442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.803095 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"eb99a2c3152967a718ee0e335e941e1ff543843f9c6d6b1e5ed6c86ce072b7c1"} Sep 11 02:48:47.803442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.803120 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d3a280a-c609-4d56-86c9-355ad2d57776","Type":"ContainerStarted","Data":"3e7c5ec5b7dbc65008fa9cde3f9ce89aed15e9d617716c8c25a71b4984b5eb68"} Sep 11 02:48:47.833815 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.833774 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:47.834167 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834134 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="prometheus" containerID="cri-o://bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" gracePeriod=600 Sep 11 02:48:47.834371 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834334 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-thanos" containerID="cri-o://16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" gracePeriod=600 Sep 11 02:48:47.834508 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834486 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy" containerID="cri-o://f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" gracePeriod=600 Sep 11 02:48:47.834574 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834526 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="thanos-sidecar" containerID="cri-o://48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" gracePeriod=600 Sep 11 02:48:47.834637 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834580 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="config-reloader" containerID="cri-o://67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" gracePeriod=600 Sep 11 02:48:47.834637 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.834609 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-web" containerID="cri-o://c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" gracePeriod=600 Sep 11 02:48:47.835428 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.835218 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.81940359 podStartE2EDuration="2.835199455s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.795865ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:48:47.835057221 +0000 UTC m=+161.477391577" watchObservedRunningTime="2026-09-11 02:48:47.835199455 +0000 UTC m=+161.477533787" Sep 11 02:48:47.865452 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:47.864880 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" Sep 11 02:48:48.099081 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.099056 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:48.153663 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.153628 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f666f4955-xwxpp"] Sep 11 02:48:48.155785 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:48:48.155759 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205352a0_cc98_4fa1_be8a_d96fb77c85b7.slice/crio-610481932b97c908d52bf604293044df08e3fc9654c4c1b23b77515dcb2d0317 WatchSource:0}: Error finding container 610481932b97c908d52bf604293044df08e3fc9654c4c1b23b77515dcb2d0317: Status 404 returned error can't find the container with id 610481932b97c908d52bf604293044df08e3fc9654c4c1b23b77515dcb2d0317 Sep 11 02:48:48.249188 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249155 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249188 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249187 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249443 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249209 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249443 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249231 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249443 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249256 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249443 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249362 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249443 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249435 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249474 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249510 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249555 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249584 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249597 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249606 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249632 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zggsr\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249634 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249666 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.249701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249693 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249763 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249771 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249827 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.249982 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250008 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250040 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs\") pod \"ca0d6194-cfae-4544-ac97-2aac95f66030\" (UID: \"ca0d6194-cfae-4544-ac97-2aac95f66030\") " Sep 11 02:48:48.250324 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250296 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.250675 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250496 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.250675 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250519 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.250675 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250533 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-metrics-client-ca\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.250675 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250548 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.250870 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.250689 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:48:48.252388 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.252337 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.252388 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.252371 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.252766 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.252507 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config" (OuterVolumeSpecName: "config") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.252837 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.252813 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:48:48.253686 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.253480 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr" (OuterVolumeSpecName: "kube-api-access-zggsr") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "kube-api-access-zggsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:48:48.253686 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.253553 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.253686 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.253625 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.253686 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.253660 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.253929 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.253891 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out" (OuterVolumeSpecName: "config-out") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:48:48.254069 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.254038 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:48:48.254679 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.254661 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.255112 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.255094 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.255296 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.255281 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.255336 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.255301 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.266164 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.266141 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config" (OuterVolumeSpecName: "web-config") pod "ca0d6194-cfae-4544-ac97-2aac95f66030" (UID: "ca0d6194-cfae-4544-ac97-2aac95f66030"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:48:48.351115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351041 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351069 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351082 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-db\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351094 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-web-config\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351115 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351107 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-kube-rbac-proxy\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351119 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351132 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca0d6194-cfae-4544-ac97-2aac95f66030-config-out\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351144 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351156 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zggsr\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-kube-api-access-zggsr\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351170 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351182 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0d6194-cfae-4544-ac97-2aac95f66030-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351194 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351206 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351218 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-grpc-tls\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351230 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca0d6194-cfae-4544-ac97-2aac95f66030-tls-assets\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.351361 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.351241 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca0d6194-cfae-4544-ac97-2aac95f66030-secret-metrics-client-certs\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:48:48.808822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.808776 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" event={"ID":"205352a0-cc98-4fa1-be8a-d96fb77c85b7","Type":"ContainerStarted","Data":"610481932b97c908d52bf604293044df08e3fc9654c4c1b23b77515dcb2d0317"} Sep 11 02:48:48.812844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812817 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" exitCode=0 Sep 11 02:48:48.812844 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812845 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" exitCode=0 Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812855 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" exitCode=0 Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812863 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" exitCode=0 Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812871 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" exitCode=0 Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812880 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" exitCode=0 Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812897 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812928 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.812982 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} Sep 11 02:48:48.813046 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813030 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} Sep 11 02:48:48.813429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813067 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.813429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813071 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} Sep 11 02:48:48.813429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813214 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} Sep 11 02:48:48.813429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813260 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} Sep 11 02:48:48.813429 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.813303 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca0d6194-cfae-4544-ac97-2aac95f66030","Type":"ContainerDied","Data":"13876b2be4659a75b8e7d2cae0bffffa54ff967cac6530465252779a7d5a71a0"} Sep 11 02:48:48.822881 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.822568 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.830950 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.830926 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.840008 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.839818 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.843275 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.843257 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:48.844911 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.844891 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:48.849133 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.849114 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.857571 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.857556 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.866047 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.866031 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.870337 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870315 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:48.870765 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870747 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="config-reloader" Sep 11 02:48:48.870822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870770 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="config-reloader" Sep 11 02:48:48.870822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870786 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="init-config-reloader" Sep 11 02:48:48.870822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870795 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="init-config-reloader" Sep 11 02:48:48.870822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870811 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-web" Sep 11 02:48:48.870822 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870820 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-web" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870839 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870848 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870872 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="prometheus" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870881 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="prometheus" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870893 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="thanos-sidecar" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870901 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="thanos-sidecar" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870910 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-thanos" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870918 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-thanos" Sep 11 02:48:48.870990 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870985 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-thanos" Sep 11 02:48:48.871360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.870997 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="thanos-sidecar" Sep 11 02:48:48.871360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.871008 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="config-reloader" Sep 11 02:48:48.871360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.871017 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="prometheus" Sep 11 02:48:48.871360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.871026 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy-web" Sep 11 02:48:48.871360 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.871034 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" containerName="kube-rbac-proxy" Sep 11 02:48:48.874475 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.874458 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.875035 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.875018 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.875102 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875043 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.875102 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875059 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.875199 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875174 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:48.875341 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.875319 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.875620 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875353 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.875620 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875620 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.875940 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.875923 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.875997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875946 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.875997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.875964 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.876244 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.876226 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.876322 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876247 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.876322 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876261 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.876536 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.876517 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.876621 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876540 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.876621 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876553 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.876795 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.876777 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.876893 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876797 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.876893 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.876816 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.877053 ip-10-0-136-112 kubenswrapper[2557]: E0911 02:48:48.877038 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.877113 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877061 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.877113 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877081 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.877394 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877369 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.877394 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877392 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.877706 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877686 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.877789 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877708 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.878004 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877981 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.878004 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.877999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7jkobqnh543rj\"" Sep 11 02:48:48.878125 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878006 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.878336 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878308 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.878390 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878340 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.878605 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878587 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 02:48:48.878605 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878600 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 02:48:48.878776 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878595 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 02:48:48.878776 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878653 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.878776 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878671 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.878992 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878871 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 02:48:48.878992 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878950 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.878992 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.878976 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.879167 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879145 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 02:48:48.879313 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879293 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.879313 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879310 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 02:48:48.879487 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879315 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.879487 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879332 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 02:48:48.879606 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879598 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 02:48:48.879744 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879621 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 02:48:48.879905 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879878 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.879988 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.879906 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.880064 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880048 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 02:48:48.880125 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880100 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5fzk4\"" Sep 11 02:48:48.880307 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880290 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 02:48:48.880307 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880294 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.880513 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880316 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.880513 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880346 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 02:48:48.880677 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880655 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.880677 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880676 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.880997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880968 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.880997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.880992 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.881318 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881294 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.881375 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881320 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.881509 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881493 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 02:48:48.881682 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881656 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.881760 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881684 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.882002 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.881981 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.882088 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.882003 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.882578 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.882530 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.882578 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.882574 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.882841 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.882816 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.882916 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.882844 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.883116 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883097 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.883116 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883116 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.883367 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883347 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.883367 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883365 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.883851 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883633 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.883851 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883658 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.883967 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.883851 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 02:48:48.884215 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884195 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.884215 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884214 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.884499 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884482 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.884554 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884500 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.884739 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884717 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.884791 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884743 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.884991 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884969 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.885050 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.884994 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.885267 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885247 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.885316 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885270 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.885557 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885537 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.885623 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885558 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.885815 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885798 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.885875 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.885816 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.886068 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886049 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.886119 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886070 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.886311 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886294 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.886353 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886311 2557 scope.go:117] "RemoveContainer" containerID="16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258" Sep 11 02:48:48.886563 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886547 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258"} err="failed to get container status \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": rpc error: code = NotFound desc = could not find container \"16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258\": container with ID starting with 16317eb181ee95f03e317fd36c55d20386208921738b4891bc5df3859dbc7258 not found: ID does not exist" Sep 11 02:48:48.886621 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886564 2557 scope.go:117] "RemoveContainer" containerID="f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484" Sep 11 02:48:48.886761 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886746 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484"} err="failed to get container status \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": rpc error: code = NotFound desc = could not find container \"f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484\": container with ID starting with f6a0f4dcb0ad02b39947c9d36515b3660e89ca99930ac21c2da84a6288403484 not found: ID does not exist" Sep 11 02:48:48.886761 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886760 2557 scope.go:117] "RemoveContainer" containerID="c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347" Sep 11 02:48:48.886955 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886936 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347"} err="failed to get container status \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": rpc error: code = NotFound desc = could not find container \"c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347\": container with ID starting with c530c60edcefad53ad91fcec487f904915d1085e6f331e85f0f138b739488347 not found: ID does not exist" Sep 11 02:48:48.886955 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.886953 2557 scope.go:117] "RemoveContainer" containerID="48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64" Sep 11 02:48:48.887176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.887157 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64"} err="failed to get container status \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": rpc error: code = NotFound desc = could not find container \"48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64\": container with ID starting with 48db597c46d0c9ab5f32cb1c6aff4108e2d444187bda1018a564f88e6bbd1f64 not found: ID does not exist" Sep 11 02:48:48.887176 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.887173 2557 scope.go:117] "RemoveContainer" containerID="67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1" Sep 11 02:48:48.888119 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.888081 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1"} err="failed to get container status \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": rpc error: code = NotFound desc = could not find container \"67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1\": container with ID starting with 67be666006ac14a7550acc98f076084de6c7d41c8b4870bd9f0f1c5fa3dba0f1 not found: ID does not exist" Sep 11 02:48:48.888119 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.888119 2557 scope.go:117] "RemoveContainer" containerID="bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd" Sep 11 02:48:48.888540 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.888515 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd"} err="failed to get container status \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": rpc error: code = NotFound desc = could not find container \"bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd\": container with ID starting with bfaa6d19b332e09b7979a5dd2b6baef880f60c8fbfab4ec1bc03573d467179fd not found: ID does not exist" Sep 11 02:48:48.888540 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.888536 2557 scope.go:117] "RemoveContainer" containerID="e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01" Sep 11 02:48:48.888872 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.888833 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01"} err="failed to get container status \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": rpc error: code = NotFound desc = could not find container \"e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01\": container with ID starting with e4f96bdf423ad0e2c054de8fd2b6e41ceaef660b0c56e77381dbbcd39131db01 not found: ID does not exist" Sep 11 02:48:48.889580 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:48.889562 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:49.058770 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058770 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59kk\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-kube-api-access-g59kk\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058796 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.058995 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.058985 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059008 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059051 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059293 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.059374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.059322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160305 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.160615 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.161070 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.160842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.163045 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.161944 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.163045 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.162025 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59kk\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-kube-api-access-g59kk\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.164178 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.163883 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.165436 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.165011 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.165436 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.165420 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.166006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.165615 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.166006 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.165620 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.166162 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.166064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-config\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.166878 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.167459 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.168265 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.168758 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.169039 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.169289 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169471 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.169294 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169851 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.169707 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.169932 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.169911 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.170034 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.170015 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/494537dc-cd34-4f63-b346-6c930c9ef5fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.170128 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.170061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/494537dc-cd34-4f63-b346-6c930c9ef5fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.170216 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.170127 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/494537dc-cd34-4f63-b346-6c930c9ef5fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.171143 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.171115 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59kk\" (UniqueName: \"kubernetes.io/projected/494537dc-cd34-4f63-b346-6c930c9ef5fe-kube-api-access-g59kk\") pod \"prometheus-k8s-0\" (UID: \"494537dc-cd34-4f63-b346-6c930c9ef5fe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.186455 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.186432 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:48:49.467274 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.467246 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:48:49.468282 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:48:49.468256 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494537dc_cd34_4f63_b346_6c930c9ef5fe.slice/crio-fb2739831b6e88ddbe65538c72a6b3d9a1f69f77dfc0e13865d731ce35b9f56f WatchSource:0}: Error finding container fb2739831b6e88ddbe65538c72a6b3d9a1f69f77dfc0e13865d731ce35b9f56f: Status 404 returned error can't find the container with id fb2739831b6e88ddbe65538c72a6b3d9a1f69f77dfc0e13865d731ce35b9f56f Sep 11 02:48:49.819612 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.819526 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"919ed92c90b465a3cbc8a0a0c7c67c90dd2c4873042d2b93326b13987b1b68ee"} Sep 11 02:48:49.819983 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:49.819620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"fb2739831b6e88ddbe65538c72a6b3d9a1f69f77dfc0e13865d731ce35b9f56f"} Sep 11 02:48:50.827061 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.827023 2557 generic.go:356] "Generic (PLEG): container finished" podID="494537dc-cd34-4f63-b346-6c930c9ef5fe" containerID="919ed92c90b465a3cbc8a0a0c7c67c90dd2c4873042d2b93326b13987b1b68ee" exitCode=0 Sep 11 02:48:50.827479 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.827108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerDied","Data":"919ed92c90b465a3cbc8a0a0c7c67c90dd2c4873042d2b93326b13987b1b68ee"} Sep 11 02:48:50.829575 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.829551 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" event={"ID":"205352a0-cc98-4fa1-be8a-d96fb77c85b7","Type":"ContainerStarted","Data":"5ec8bea67137b4622222f396f1052393f35837711ae639feb73180f02f326869"} Sep 11 02:48:50.829705 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.829594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" event={"ID":"205352a0-cc98-4fa1-be8a-d96fb77c85b7","Type":"ContainerStarted","Data":"df4b50d5d6406568038b2f119ff095374bbe7ea9b5a07c9490f03c41b3a4209d"} Sep 11 02:48:50.829705 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.829614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" event={"ID":"205352a0-cc98-4fa1-be8a-d96fb77c85b7","Type":"ContainerStarted","Data":"f9b284b90a73c18a1436beab851f92199a701b939beb3e5cedcc6e611259c343"} Sep 11 02:48:50.842003 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.841982 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0d6194-cfae-4544-ac97-2aac95f66030" path="/var/lib/kubelet/pods/ca0d6194-cfae-4544-ac97-2aac95f66030/volumes" Sep 11 02:48:50.872261 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:50.872218 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f666f4955-xwxpp" podStartSLOduration=2.001347834 podStartE2EDuration="3.872202846s" totalImagesPullingTime="1.870855012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:48:50.871453602 +0000 UTC m=+164.513787931" watchObservedRunningTime="2026-09-11 02:48:50.872202846 +0000 UTC m=+164.514537175" Sep 11 02:48:51.838314 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"e6fcdc67d6408317f194d93c4212490b5e8cf9bb4f0f9f412128948289aada82"} Sep 11 02:48:51.838818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838361 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"36bb39995ccb845a4d3305b846f9d94c7e2de88d18e388566d2802e5d71d3619"} Sep 11 02:48:51.838818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"9f7a492084ef0112b42233095ab4cf3d21946cd7de83c531c72837fc6cec7fbb"} Sep 11 02:48:51.838818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838468 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"88bfbbf488419c4a2c864956476d8c722072856ec8fe4b8fd508e52fc613b585"} Sep 11 02:48:51.838818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838507 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"0c67d1ca8d98e5509a4bc75ed407314f1a5af91457962e39105b4660c1687611"} Sep 11 02:48:51.838818 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.838548 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"494537dc-cd34-4f63-b346-6c930c9ef5fe","Type":"ContainerStarted","Data":"bf05793e4bdcec43206db89b32e17a9a65070dc1a4143007ee9572df6f22d683"} Sep 11 02:48:51.864271 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:51.864218 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.842193489 podStartE2EDuration="3.864197897s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.004408ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:48:51.862253758 +0000 UTC m=+165.504588089" watchObservedRunningTime="2026-09-11 02:48:51.864197897 +0000 UTC m=+165.506532227" Sep 11 02:48:54.187221 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:48:54.187185 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:49:49.186834 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:49:49.186784 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:49:49.203005 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:49:49.202977 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:49:50.071144 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:49:50.071118 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:51:06.758026 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:06.758001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:51:06.760667 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:06.760644 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:51:06.762020 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:06.762001 2557 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 02:51:53.880655 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.880619 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6sb8n"] Sep 11 02:51:53.883952 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.883933 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:53.886730 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.886708 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 11 02:51:53.886730 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.886715 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 11 02:51:53.887722 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.887708 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g65l8\"" Sep 11 02:51:53.898141 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.898120 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6sb8n"] Sep 11 02:51:53.976549 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.976516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng6w\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-kube-api-access-qng6w\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:53.976712 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:53.976555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-bound-sa-token\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.077676 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.077632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng6w\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-kube-api-access-qng6w\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.077676 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.077685 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-bound-sa-token\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.088858 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.088831 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng6w\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-kube-api-access-qng6w\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.089027 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.089007 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c005e8fd-d586-4f47-9f58-f9684dbccac4-bound-sa-token\") pod \"cert-manager-55b4d954d5-6sb8n\" (UID: \"c005e8fd-d586-4f47-9f58-f9684dbccac4\") " pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.202415 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.202365 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6sb8n" Sep 11 02:51:54.491843 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.491768 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6sb8n"] Sep 11 02:51:54.494833 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:51:54.494809 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc005e8fd_d586_4f47_9f58_f9684dbccac4.slice/crio-1c1cc635c82b352947a4c2f61cabd70b70b991b88fd1166386dd2237bdc63c5c WatchSource:0}: Error finding container 1c1cc635c82b352947a4c2f61cabd70b70b991b88fd1166386dd2237bdc63c5c: Status 404 returned error can't find the container with id 1c1cc635c82b352947a4c2f61cabd70b70b991b88fd1166386dd2237bdc63c5c Sep 11 02:51:54.496963 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.496944 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:51:54.534942 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:54.534902 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6sb8n" event={"ID":"c005e8fd-d586-4f47-9f58-f9684dbccac4","Type":"ContainerStarted","Data":"1c1cc635c82b352947a4c2f61cabd70b70b991b88fd1166386dd2237bdc63c5c"} Sep 11 02:51:58.556381 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:58.556345 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6sb8n" event={"ID":"c005e8fd-d586-4f47-9f58-f9684dbccac4","Type":"ContainerStarted","Data":"76ab8cda8b66237016aed728aa8b387bfb72af4b8803013e49bfdd26c072ee56"} Sep 11 02:51:58.579826 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:51:58.579776 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6sb8n" podStartSLOduration=2.454124602 podStartE2EDuration="5.57976028s" totalImagesPullingTime="3.125635678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:51:58.578808823 +0000 UTC m=+352.221143146" watchObservedRunningTime="2026-09-11 02:51:58.57976028 +0000 UTC m=+352.222094612" Sep 11 02:52:11.115320 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.115292 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn"] Sep 11 02:52:11.120161 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.120138 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.122685 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.122664 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 11 02:52:11.122949 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.122932 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-kb8pz\"" Sep 11 02:52:11.123701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.123683 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:52:11.127647 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.127627 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn"] Sep 11 02:52:11.221042 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.221012 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqppp\" (UniqueName: \"kubernetes.io/projected/b262d108-ddfd-4167-8232-f26cce8fc28c-kube-api-access-kqppp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.221221 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.221078 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b262d108-ddfd-4167-8232-f26cce8fc28c-tmp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.321894 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.321862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b262d108-ddfd-4167-8232-f26cce8fc28c-tmp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.322038 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.321903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqppp\" (UniqueName: \"kubernetes.io/projected/b262d108-ddfd-4167-8232-f26cce8fc28c-kube-api-access-kqppp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.322196 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.322178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b262d108-ddfd-4167-8232-f26cce8fc28c-tmp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.331517 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.331493 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqppp\" (UniqueName: \"kubernetes.io/projected/b262d108-ddfd-4167-8232-f26cce8fc28c-kube-api-access-kqppp\") pod \"jobset-operator-5bc45f897-8v4vn\" (UID: \"b262d108-ddfd-4167-8232-f26cce8fc28c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.429701 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.429672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" Sep 11 02:52:11.705994 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:11.705962 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn"] Sep 11 02:52:12.612109 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:12.612070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" event={"ID":"b262d108-ddfd-4167-8232-f26cce8fc28c","Type":"ContainerStarted","Data":"3f4166cef56e9b1f4ea916e03a9684f8d386607da9a1ccddea0148ab10a4615e"} Sep 11 02:52:14.622289 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:14.622255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" event={"ID":"b262d108-ddfd-4167-8232-f26cce8fc28c","Type":"ContainerStarted","Data":"8b870e392229c4fef3198f73ff5611833c9c1175c1c9ae56978b9a419ed03b9c"} Sep 11 02:52:14.641982 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:14.641929 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-8v4vn" podStartSLOduration=0.859204246 podStartE2EDuration="3.641909282s" totalImagesPullingTime="2.782705036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:52:14.640162796 +0000 UTC m=+368.282497125" watchObservedRunningTime="2026-09-11 02:52:14.641909282 +0000 UTC m=+368.284243617" Sep 11 02:52:40.315903 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.315864 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq"] Sep 11 02:52:40.319441 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.319419 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.322106 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.322083 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 11 02:52:40.322223 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.322122 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 11 02:52:40.322349 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.322336 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 11 02:52:40.323284 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.323266 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-cvfsg\"" Sep 11 02:52:40.323341 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.323294 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 11 02:52:40.327155 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.327138 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq"] Sep 11 02:52:40.462794 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.462756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1bce5808-5142-45a1-8143-c7715e75221c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.462968 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.462801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84nk9\" (UniqueName: \"kubernetes.io/projected/1bce5808-5142-45a1-8143-c7715e75221c-kube-api-access-84nk9\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.462968 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.462874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bce5808-5142-45a1-8143-c7715e75221c-cert\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.564192 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.564153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1bce5808-5142-45a1-8143-c7715e75221c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.564192 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.564196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84nk9\" (UniqueName: \"kubernetes.io/projected/1bce5808-5142-45a1-8143-c7715e75221c-kube-api-access-84nk9\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.564469 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.564240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bce5808-5142-45a1-8143-c7715e75221c-cert\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.564914 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.564895 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1bce5808-5142-45a1-8143-c7715e75221c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.566739 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.566679 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bce5808-5142-45a1-8143-c7715e75221c-cert\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.572456 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.572430 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84nk9\" (UniqueName: \"kubernetes.io/projected/1bce5808-5142-45a1-8143-c7715e75221c-kube-api-access-84nk9\") pod \"kubeflow-trainer-controller-manager-64ddd974b6-6s5lq\" (UID: \"1bce5808-5142-45a1-8143-c7715e75221c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.630427 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.630387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:40.899275 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:40.899236 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq"] Sep 11 02:52:40.901420 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:52:40.901384 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bce5808_5142_45a1_8143_c7715e75221c.slice/crio-c8d7e9f4e01a915ac586765b446fc8cd84c337c425fc477bb0022fd760fc32e8 WatchSource:0}: Error finding container c8d7e9f4e01a915ac586765b446fc8cd84c337c425fc477bb0022fd760fc32e8: Status 404 returned error can't find the container with id c8d7e9f4e01a915ac586765b446fc8cd84c337c425fc477bb0022fd760fc32e8 Sep 11 02:52:41.732264 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:41.732226 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" event={"ID":"1bce5808-5142-45a1-8143-c7715e75221c","Type":"ContainerStarted","Data":"c8d7e9f4e01a915ac586765b446fc8cd84c337c425fc477bb0022fd760fc32e8"} Sep 11 02:52:43.741498 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:43.741463 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" event={"ID":"1bce5808-5142-45a1-8143-c7715e75221c","Type":"ContainerStarted","Data":"4a79a8b5fde24858e7a2b3efa0f8b4402853b7ce55a7f137535e82561767bb26"} Sep 11 02:52:43.741898 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:43.741570 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:52:43.758343 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:43.758295 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podStartSLOduration=1.356223562 podStartE2EDuration="3.758281404s" totalImagesPullingTime="2.402057842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:52:43.757677103 +0000 UTC m=+397.400011432" watchObservedRunningTime="2026-09-11 02:52:43.758281404 +0000 UTC m=+397.400615733" Sep 11 02:52:59.747887 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:52:59.747837 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:53:14.747374 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:53:14.747339 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:53:29.746931 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:53:29.746849 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:53:44.747042 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:53:44.747004 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:53:47.836152 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:53:47.836116 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:54:02.837068 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:54:02.837029 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:54:17.837584 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:54:17.837545 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:54:32.837808 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:54:32.837760 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" podUID="1bce5808-5142-45a1-8143-c7715e75221c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 11 02:54:47.839549 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:54:47.839518 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-64ddd974b6-6s5lq" Sep 11 02:55:55.311813 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.311780 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f"] Sep 11 02:55:55.314958 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.314942 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:55:55.317325 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.317309 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"openshift-service-ca.crt\"" Sep 11 02:55:55.317419 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.317372 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"default-dockercfg-k2t2z\"" Sep 11 02:55:55.318287 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.318273 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"kube-root-ca.crt\"" Sep 11 02:55:55.324806 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.324785 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f"] Sep 11 02:55:55.398825 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.398798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r58t\" (UniqueName: \"kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t\") pod \"progression-enabled-node-0-0-zl79f\" (UID: \"9831cc06-5d1c-455f-81f4-eef3a672dcf6\") " pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:55:55.500167 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.500140 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r58t\" (UniqueName: \"kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t\") pod \"progression-enabled-node-0-0-zl79f\" (UID: \"9831cc06-5d1c-455f-81f4-eef3a672dcf6\") " pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:55:55.508010 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.507981 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r58t\" (UniqueName: \"kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t\") pod \"progression-enabled-node-0-0-zl79f\" (UID: \"9831cc06-5d1c-455f-81f4-eef3a672dcf6\") " pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:55:55.626368 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.626307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:55:55.896358 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:55.896292 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f"] Sep 11 02:55:55.899117 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:55:55.899094 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9831cc06_5d1c_455f_81f4_eef3a672dcf6.slice/crio-3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c WatchSource:0}: Error finding container 3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c: Status 404 returned error can't find the container with id 3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c Sep 11 02:55:56.516812 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:55:56.516762 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" event={"ID":"9831cc06-5d1c-455f-81f4-eef3a672dcf6","Type":"ContainerStarted","Data":"3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c"} Sep 11 02:56:06.788290 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:56:06.788258 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:56:06.789295 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:56:06.789274 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 02:57:33.999742 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:33.999703 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" event={"ID":"9831cc06-5d1c-455f-81f4-eef3a672dcf6","Type":"ContainerStarted","Data":"6d765c3074e520ae57b4be799fe435e1b3909c94eed85f1014c66d781d1df5a8"} Sep 11 02:57:34.000256 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:33.999792 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:57:34.027560 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:34.027517 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" podStartSLOduration=1.857591372 podStartE2EDuration="1m39.027502568s" totalImagesPullingTime="1m37.169911196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:57:34.025382351 +0000 UTC m=+687.667716691" watchObservedRunningTime="2026-09-11 02:57:34.027502568 +0000 UTC m=+687.669836898" Sep 11 02:57:35.002894 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:35.002863 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:57:56.231211 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:56.231162 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": read tcp 10.134.0.2:44894->10.134.0.25:28080: read: connection reset by peer" Sep 11 02:57:57.000149 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:57.000115 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Sep 11 02:57:57.000329 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:57.000221 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:57:57.000749 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:57.000723 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Sep 11 02:57:57.103261 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:57.103233 2557 generic.go:356] "Generic (PLEG): container finished" podID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerID="6d765c3074e520ae57b4be799fe435e1b3909c94eed85f1014c66d781d1df5a8" exitCode=0 Sep 11 02:57:57.103387 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:57.103309 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" event={"ID":"9831cc06-5d1c-455f-81f4-eef3a672dcf6","Type":"ContainerDied","Data":"6d765c3074e520ae57b4be799fe435e1b3909c94eed85f1014c66d781d1df5a8"} Sep 11 02:57:58.251431 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:58.251378 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:57:58.417790 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:58.417762 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r58t\" (UniqueName: \"kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t\") pod \"9831cc06-5d1c-455f-81f4-eef3a672dcf6\" (UID: \"9831cc06-5d1c-455f-81f4-eef3a672dcf6\") " Sep 11 02:57:58.420027 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:58.419997 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t" (OuterVolumeSpecName: "kube-api-access-4r58t") pod "9831cc06-5d1c-455f-81f4-eef3a672dcf6" (UID: "9831cc06-5d1c-455f-81f4-eef3a672dcf6"). InnerVolumeSpecName "kube-api-access-4r58t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:57:58.518536 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:58.518503 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r58t\" (UniqueName: \"kubernetes.io/projected/9831cc06-5d1c-455f-81f4-eef3a672dcf6-kube-api-access-4r58t\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:57:59.112301 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.112227 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" Sep 11 02:57:59.112301 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.112241 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f" event={"ID":"9831cc06-5d1c-455f-81f4-eef3a672dcf6","Type":"ContainerDied","Data":"3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c"} Sep 11 02:57:59.112301 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.112290 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cd5da26722666d533dff320407c1752a1c70c1915cc12c24002cb75169e6e1c" Sep 11 02:57:59.774933 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.774904 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck"] Sep 11 02:57:59.775293 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.775225 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" Sep 11 02:57:59.775293 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.775236 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" Sep 11 02:57:59.775293 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.775294 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" containerName="node" Sep 11 02:57:59.795279 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.795245 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck"] Sep 11 02:57:59.795466 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.795347 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:57:59.798317 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.798281 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"openshift-service-ca.crt\"" Sep 11 02:57:59.798458 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.798330 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"kube-root-ca.crt\"" Sep 11 02:57:59.798458 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.798412 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"default-dockercfg-k2t2z\"" Sep 11 02:57:59.829326 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.829300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fth\" (UniqueName: \"kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth\") pod \"progression-disabled-node-0-0-n6tck\" (UID: \"65cf3caa-8275-4bf5-90a5-708793633c1c\") " pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:57:59.930052 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.930009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fth\" (UniqueName: \"kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth\") pod \"progression-disabled-node-0-0-n6tck\" (UID: \"65cf3caa-8275-4bf5-90a5-708793633c1c\") " pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:57:59.937977 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:57:59.937945 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fth\" (UniqueName: \"kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth\") pod \"progression-disabled-node-0-0-n6tck\" (UID: \"65cf3caa-8275-4bf5-90a5-708793633c1c\") " pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:00.105057 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:00.104977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:00.397526 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:00.397504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck"] Sep 11 02:58:00.399866 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:58:00.399833 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cf3caa_8275_4bf5_90a5_708793633c1c.slice/crio-b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897 WatchSource:0}: Error finding container b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897: Status 404 returned error can't find the container with id b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897 Sep 11 02:58:01.125801 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:01.125759 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" event={"ID":"65cf3caa-8275-4bf5-90a5-708793633c1c","Type":"ContainerStarted","Data":"6944e8aba0801f446b292f46ce16b8f6c663f8e897c419cf0b2f5b27f1fc1c42"} Sep 11 02:58:01.126265 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:01.125824 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" event={"ID":"65cf3caa-8275-4bf5-90a5-708793633c1c","Type":"ContainerStarted","Data":"b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897"} Sep 11 02:58:01.126541 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:01.126518 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:01.144683 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:01.144639 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" podStartSLOduration=2.144609056 podStartE2EDuration="2.144609056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:58:01.142943579 +0000 UTC m=+714.785277904" watchObservedRunningTime="2026-09-11 02:58:01.144609056 +0000 UTC m=+714.786943388" Sep 11 02:58:02.129620 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:02.129589 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:24.127451 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:24.127396 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" podUID="65cf3caa-8275-4bf5-90a5-708793633c1c" containerName="node" probeResult="failure" output="Get \"http://10.134.0.26:28080/metrics\": dial tcp 10.134.0.26:28080: connect: connection refused" Sep 11 02:58:24.228159 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:24.228127 2557 generic.go:356] "Generic (PLEG): container finished" podID="65cf3caa-8275-4bf5-90a5-708793633c1c" containerID="6944e8aba0801f446b292f46ce16b8f6c663f8e897c419cf0b2f5b27f1fc1c42" exitCode=0 Sep 11 02:58:24.228312 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:24.228166 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" event={"ID":"65cf3caa-8275-4bf5-90a5-708793633c1c","Type":"ContainerDied","Data":"6944e8aba0801f446b292f46ce16b8f6c663f8e897c419cf0b2f5b27f1fc1c42"} Sep 11 02:58:25.356854 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:25.356828 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:25.441558 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:25.441520 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4fth\" (UniqueName: \"kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth\") pod \"65cf3caa-8275-4bf5-90a5-708793633c1c\" (UID: \"65cf3caa-8275-4bf5-90a5-708793633c1c\") " Sep 11 02:58:25.443588 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:25.443550 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth" (OuterVolumeSpecName: "kube-api-access-q4fth") pod "65cf3caa-8275-4bf5-90a5-708793633c1c" (UID: "65cf3caa-8275-4bf5-90a5-708793633c1c"). InnerVolumeSpecName "kube-api-access-q4fth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:58:25.542037 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:25.541986 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4fth\" (UniqueName: \"kubernetes.io/projected/65cf3caa-8275-4bf5-90a5-708793633c1c-kube-api-access-q4fth\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:58:26.238013 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:26.237984 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" Sep 11 02:58:26.238150 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:26.237986 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck" event={"ID":"65cf3caa-8275-4bf5-90a5-708793633c1c","Type":"ContainerDied","Data":"b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897"} Sep 11 02:58:26.238150 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:26.238106 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4120ea56092874815128b3d6eaa990aff7d7b5a5a0846bbe3ecfda97c374897" Sep 11 02:58:34.760720 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.760692 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz"] Sep 11 02:58:34.761151 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.761015 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65cf3caa-8275-4bf5-90a5-708793633c1c" containerName="node" Sep 11 02:58:34.761151 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.761025 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="65cf3caa-8275-4bf5-90a5-708793633c1c" containerName="node" Sep 11 02:58:34.761151 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.761086 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="65cf3caa-8275-4bf5-90a5-708793633c1c" containerName="node" Sep 11 02:58:34.763241 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.763225 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:34.765738 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.765716 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"openshift-service-ca.crt\"" Sep 11 02:58:34.765997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.765980 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"default-dockercfg-k2t2z\"" Sep 11 02:58:34.765997 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.765990 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"kube-root-ca.crt\"" Sep 11 02:58:34.772008 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.771989 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz"] Sep 11 02:58:34.915597 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:34.915569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdscc\" (UniqueName: \"kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc\") pod \"progression-invalid-node-0-0-r9lvz\" (UID: \"b972c7e3-3349-4e5d-aafc-385cf1acac89\") " pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:35.016614 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:35.016559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdscc\" (UniqueName: \"kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc\") pod \"progression-invalid-node-0-0-r9lvz\" (UID: \"b972c7e3-3349-4e5d-aafc-385cf1acac89\") " pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:35.024786 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:35.024765 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdscc\" (UniqueName: \"kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc\") pod \"progression-invalid-node-0-0-r9lvz\" (UID: \"b972c7e3-3349-4e5d-aafc-385cf1acac89\") " pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:35.072996 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:35.072972 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:35.342194 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:35.342171 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz"] Sep 11 02:58:35.344683 ip-10-0-136-112 kubenswrapper[2557]: W0911 02:58:35.344658 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb972c7e3_3349_4e5d_aafc_385cf1acac89.slice/crio-9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd WatchSource:0}: Error finding container 9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd: Status 404 returned error can't find the container with id 9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd Sep 11 02:58:36.284442 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:36.284392 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" event={"ID":"b972c7e3-3349-4e5d-aafc-385cf1acac89","Type":"ContainerStarted","Data":"55f3b46bc4c90a506727140277b3894193b1faa484950444b230a620299f770b"} Sep 11 02:58:36.284803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:36.284456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" event={"ID":"b972c7e3-3349-4e5d-aafc-385cf1acac89","Type":"ContainerStarted","Data":"9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd"} Sep 11 02:58:36.284803 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:36.284530 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:36.304655 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:36.304606 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" podStartSLOduration=2.304592016 podStartE2EDuration="2.304592016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:58:36.302470809 +0000 UTC m=+749.944805139" watchObservedRunningTime="2026-09-11 02:58:36.304592016 +0000 UTC m=+749.946926345" Sep 11 02:58:37.287383 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:37.287354 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:58.378173 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:58.378134 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" probeResult="failure" output="Get \"http://10.134.0.27:28080/metrics\": read tcp 10.134.0.2:35676->10.134.0.27:28080: read: connection reset by peer" Sep 11 02:58:59.285766 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:59.285727 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" probeResult="failure" output="Get \"http://10.134.0.27:28080/metrics\": dial tcp 10.134.0.27:28080: connect: connection refused" Sep 11 02:58:59.285924 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:59.285827 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:58:59.286217 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:59.286195 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" probeResult="failure" output="Get \"http://10.134.0.27:28080/metrics\": dial tcp 10.134.0.27:28080: connect: connection refused" Sep 11 02:58:59.388799 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:59.388768 2557 generic.go:356] "Generic (PLEG): container finished" podID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerID="55f3b46bc4c90a506727140277b3894193b1faa484950444b230a620299f770b" exitCode=0 Sep 11 02:58:59.389205 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:58:59.388822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" event={"ID":"b972c7e3-3349-4e5d-aafc-385cf1acac89","Type":"ContainerDied","Data":"55f3b46bc4c90a506727140277b3894193b1faa484950444b230a620299f770b"} Sep 11 02:59:00.527094 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:00.527071 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:59:00.606419 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:00.606377 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdscc\" (UniqueName: \"kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc\") pod \"b972c7e3-3349-4e5d-aafc-385cf1acac89\" (UID: \"b972c7e3-3349-4e5d-aafc-385cf1acac89\") " Sep 11 02:59:00.608445 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:00.608395 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc" (OuterVolumeSpecName: "kube-api-access-wdscc") pod "b972c7e3-3349-4e5d-aafc-385cf1acac89" (UID: "b972c7e3-3349-4e5d-aafc-385cf1acac89"). InnerVolumeSpecName "kube-api-access-wdscc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:59:00.707497 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:00.707447 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdscc\" (UniqueName: \"kubernetes.io/projected/b972c7e3-3349-4e5d-aafc-385cf1acac89-kube-api-access-wdscc\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 02:59:01.398998 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:01.398966 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" event={"ID":"b972c7e3-3349-4e5d-aafc-385cf1acac89","Type":"ContainerDied","Data":"9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd"} Sep 11 02:59:01.398998 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:01.398988 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz" Sep 11 02:59:01.399196 ip-10-0-136-112 kubenswrapper[2557]: I0911 02:59:01.399009 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b9478c460de015a555df5163b1c63061cae95228778e0ec383068771c458dfd" Sep 11 03:00:42.426727 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.426695 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf"] Sep 11 03:00:42.427191 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.427042 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" Sep 11 03:00:42.427191 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.427053 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" Sep 11 03:00:42.427191 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.427114 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" containerName="node" Sep 11 03:00:42.429189 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.429171 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:42.431885 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.431854 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"openshift-service-ca.crt\"" Sep 11 03:00:42.431885 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.431877 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"kube-root-ca.crt\"" Sep 11 03:00:42.432961 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.432939 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-vtzw9\"/\"default-dockercfg-k2t2z\"" Sep 11 03:00:42.438825 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.438803 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf"] Sep 11 03:00:42.522113 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.522081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hwb\" (UniqueName: \"kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb\") pod \"progression-no-metrics-node-0-0-j75vf\" (UID: \"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b\") " pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:42.622834 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.622799 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hwb\" (UniqueName: \"kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb\") pod \"progression-no-metrics-node-0-0-j75vf\" (UID: \"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b\") " pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:42.631627 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.631590 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hwb\" (UniqueName: \"kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb\") pod \"progression-no-metrics-node-0-0-j75vf\" (UID: \"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b\") " pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:42.738963 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:42.738878 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:43.007571 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:43.007547 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf"] Sep 11 03:00:43.009884 ip-10-0-136-112 kubenswrapper[2557]: W0911 03:00:43.009857 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e782d7_a3d3_45ef_b2e8_e5dd11a76f3b.slice/crio-e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67 WatchSource:0}: Error finding container e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67: Status 404 returned error can't find the container with id e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67 Sep 11 03:00:43.874808 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:43.874771 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" event={"ID":"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b","Type":"ContainerStarted","Data":"b6c97dfc8177a460ca8319fb27c4fbe9abb39c377c17c53e626081cddc2e2434"} Sep 11 03:00:43.875172 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:43.874830 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" event={"ID":"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b","Type":"ContainerStarted","Data":"e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67"} Sep 11 03:00:43.894344 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:43.894295 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" podStartSLOduration=1.894280455 podStartE2EDuration="1.894280455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:00:43.892591814 +0000 UTC m=+877.534926144" watchObservedRunningTime="2026-09-11 03:00:43.894280455 +0000 UTC m=+877.536614784" Sep 11 03:00:48.898055 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:48.898026 2557 generic.go:356] "Generic (PLEG): container finished" podID="90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" containerID="b6c97dfc8177a460ca8319fb27c4fbe9abb39c377c17c53e626081cddc2e2434" exitCode=0 Sep 11 03:00:48.898490 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:48.898091 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" event={"ID":"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b","Type":"ContainerDied","Data":"b6c97dfc8177a460ca8319fb27c4fbe9abb39c377c17c53e626081cddc2e2434"} Sep 11 03:00:50.028731 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.028707 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:50.086320 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.086292 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47hwb\" (UniqueName: \"kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb\") pod \"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b\" (UID: \"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b\") " Sep 11 03:00:50.088325 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.088301 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb" (OuterVolumeSpecName: "kube-api-access-47hwb") pod "90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" (UID: "90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b"). InnerVolumeSpecName "kube-api-access-47hwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:00:50.187924 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.187842 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47hwb\" (UniqueName: \"kubernetes.io/projected/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b-kube-api-access-47hwb\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 03:00:50.909713 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.909687 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" Sep 11 03:00:50.909713 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.909694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf" event={"ID":"90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b","Type":"ContainerDied","Data":"e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67"} Sep 11 03:00:50.909902 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:50.909733 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1e7ead1ede29c5cdfa1b08a5373b33abda13523c59b66b24f8c908c7a15fa67" Sep 11 03:00:52.787877 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.787843 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knccf/must-gather-s72bv"] Sep 11 03:00:52.788232 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.788174 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" containerName="node" Sep 11 03:00:52.788232 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.788184 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" containerName="node" Sep 11 03:00:52.788306 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.788238 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" containerName="node" Sep 11 03:00:52.790474 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.790450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.793105 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.793085 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knccf\"/\"openshift-service-ca.crt\"" Sep 11 03:00:52.794079 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.794060 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-knccf\"/\"default-dockercfg-9wfw7\"" Sep 11 03:00:52.794079 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.794079 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knccf\"/\"kube-root-ca.crt\"" Sep 11 03:00:52.798631 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.798608 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knccf/must-gather-s72bv"] Sep 11 03:00:52.810437 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.810366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbgq\" (UniqueName: \"kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.810560 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.810539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.911308 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.911276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbgq\" (UniqueName: \"kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.911525 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.911329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.911640 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.911623 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:52.919219 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:52.919191 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbgq\" (UniqueName: \"kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq\") pod \"must-gather-s72bv\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:53.099978 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:53.099902 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:00:53.368432 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:53.368391 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knccf/must-gather-s72bv"] Sep 11 03:00:53.370837 ip-10-0-136-112 kubenswrapper[2557]: W0911 03:00:53.370814 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeddc58ad_fec2_4f3c_914f_3283d444b61c.slice/crio-2167fe2de2a188760982de4e4d2b9bb663001cb6a0084453afbd67214bbc34fd WatchSource:0}: Error finding container 2167fe2de2a188760982de4e4d2b9bb663001cb6a0084453afbd67214bbc34fd: Status 404 returned error can't find the container with id 2167fe2de2a188760982de4e4d2b9bb663001cb6a0084453afbd67214bbc34fd Sep 11 03:00:53.372615 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:53.372598 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 03:00:53.925312 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:53.925281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knccf/must-gather-s72bv" event={"ID":"eddc58ad-fec2-4f3c-914f-3283d444b61c","Type":"ContainerStarted","Data":"2167fe2de2a188760982de4e4d2b9bb663001cb6a0084453afbd67214bbc34fd"} Sep 11 03:00:57.485527 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.485490 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck"] Sep 11 03:00:57.494566 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.494535 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-disabled-node-0-0-n6tck"] Sep 11 03:00:57.498851 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.498821 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f"] Sep 11 03:00:57.502170 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.502128 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-enabled-node-0-0-zl79f"] Sep 11 03:00:57.509302 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.509276 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz"] Sep 11 03:00:57.514532 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.514508 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-invalid-node-0-0-r9lvz"] Sep 11 03:00:57.528517 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.528459 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf"] Sep 11 03:00:57.531005 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:57.530980 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-vtzw9/progression-no-metrics-node-0-0-j75vf"] Sep 11 03:00:58.841816 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:58.841785 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65cf3caa-8275-4bf5-90a5-708793633c1c" path="/var/lib/kubelet/pods/65cf3caa-8275-4bf5-90a5-708793633c1c/volumes" Sep 11 03:00:58.842274 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:58.842120 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b" path="/var/lib/kubelet/pods/90e782d7-a3d3-45ef-b2e8-e5dd11a76f3b/volumes" Sep 11 03:00:58.842457 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:58.842443 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9831cc06-5d1c-455f-81f4-eef3a672dcf6" path="/var/lib/kubelet/pods/9831cc06-5d1c-455f-81f4-eef3a672dcf6/volumes" Sep 11 03:00:58.842717 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:58.842705 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b972c7e3-3349-4e5d-aafc-385cf1acac89" path="/var/lib/kubelet/pods/b972c7e3-3349-4e5d-aafc-385cf1acac89/volumes" Sep 11 03:00:59.964972 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:59.964917 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knccf/must-gather-s72bv" event={"ID":"eddc58ad-fec2-4f3c-914f-3283d444b61c","Type":"ContainerStarted","Data":"1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676"} Sep 11 03:00:59.965447 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:59.964978 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knccf/must-gather-s72bv" event={"ID":"eddc58ad-fec2-4f3c-914f-3283d444b61c","Type":"ContainerStarted","Data":"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d"} Sep 11 03:00:59.981176 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:00:59.981120 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-knccf/must-gather-s72bv" podStartSLOduration=1.743399527 podStartE2EDuration="7.981098243s" totalImagesPullingTime="6.237698716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:00:59.978992994 +0000 UTC m=+893.621327340" watchObservedRunningTime="2026-09-11 03:00:59.981098243 +0000 UTC m=+893.623432574" Sep 11 03:01:06.823443 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:06.823394 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 03:01:06.824245 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:06.824226 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 03:01:46.217542 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:46.217510 2557 generic.go:356] "Generic (PLEG): container finished" podID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerID="9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d" exitCode=0 Sep 11 03:01:46.217963 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:46.217578 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knccf/must-gather-s72bv" event={"ID":"eddc58ad-fec2-4f3c-914f-3283d444b61c","Type":"ContainerDied","Data":"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d"} Sep 11 03:01:46.217963 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:46.217929 2557 scope.go:117] "RemoveContainer" containerID="9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d" Sep 11 03:01:46.373464 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:46.370631 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knccf_must-gather-s72bv_eddc58ad-fec2-4f3c-914f-3283d444b61c/gather/0.log" Sep 11 03:01:49.577055 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:49.576966 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4pjvl_8ce6e9ac-6d30-4ab2-8352-fa437f399915/global-pull-secret-syncer/0.log" Sep 11 03:01:49.808196 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:49.808170 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pl8hn_b8498562-4d72-46f3-a8db-5e6b7b9a51e4/konnectivity-agent/0.log" Sep 11 03:01:49.857306 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:49.857227 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-112.ec2.internal_02c674f7b3e783f8387eda67eea537c8/haproxy/0.log" Sep 11 03:01:51.723263 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:51.723225 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-knccf/must-gather-s72bv"] Sep 11 03:01:51.723840 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:51.723495 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-knccf/must-gather-s72bv" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="copy" containerID="cri-o://1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676" gracePeriod=2 Sep 11 03:01:51.728075 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:51.728050 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-knccf/must-gather-s72bv"] Sep 11 03:01:51.956127 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:51.956106 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knccf_must-gather-s72bv_eddc58ad-fec2-4f3c-914f-3283d444b61c/copy/0.log" Sep 11 03:01:51.958765 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:51.958746 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:01:51.961114 ip-10-0-136-112 kubenswrapper[2557]: E0911 03:01:51.961089 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s72bv\" is forbidden: User \"system:node:ip-10-0-136-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-knccf\": no relationship found between node 'ip-10-0-136-112.ec2.internal' and this object" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:01:52.046948 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.046889 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output\") pod \"eddc58ad-fec2-4f3c-914f-3283d444b61c\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " Sep 11 03:01:52.047061 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.046978 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dbgq\" (UniqueName: \"kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq\") pod \"eddc58ad-fec2-4f3c-914f-3283d444b61c\" (UID: \"eddc58ad-fec2-4f3c-914f-3283d444b61c\") " Sep 11 03:01:52.048185 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.048159 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "eddc58ad-fec2-4f3c-914f-3283d444b61c" (UID: "eddc58ad-fec2-4f3c-914f-3283d444b61c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 03:01:52.049213 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.049186 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq" (OuterVolumeSpecName: "kube-api-access-7dbgq") pod "eddc58ad-fec2-4f3c-914f-3283d444b61c" (UID: "eddc58ad-fec2-4f3c-914f-3283d444b61c"). InnerVolumeSpecName "kube-api-access-7dbgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:01:52.147686 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.147648 2557 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eddc58ad-fec2-4f3c-914f-3283d444b61c-must-gather-output\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 03:01:52.147686 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.147682 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dbgq\" (UniqueName: \"kubernetes.io/projected/eddc58ad-fec2-4f3c-914f-3283d444b61c-kube-api-access-7dbgq\") on node \"ip-10-0-136-112.ec2.internal\" DevicePath \"\"" Sep 11 03:01:52.248544 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.248520 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knccf_must-gather-s72bv_eddc58ad-fec2-4f3c-914f-3283d444b61c/copy/0.log" Sep 11 03:01:52.248889 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.248864 2557 generic.go:356] "Generic (PLEG): container finished" podID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerID="1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676" exitCode=143 Sep 11 03:01:52.248986 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.248907 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:01:52.248986 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.248943 2557 scope.go:117] "RemoveContainer" containerID="1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676" Sep 11 03:01:52.251053 ip-10-0-136-112 kubenswrapper[2557]: E0911 03:01:52.251023 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s72bv\" is forbidden: User \"system:node:ip-10-0-136-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-knccf\": no relationship found between node 'ip-10-0-136-112.ec2.internal' and this object" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:01:52.257516 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.257499 2557 scope.go:117] "RemoveContainer" containerID="9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d" Sep 11 03:01:52.258566 ip-10-0-136-112 kubenswrapper[2557]: E0911 03:01:52.258541 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s72bv\" is forbidden: User \"system:node:ip-10-0-136-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-knccf\": no relationship found between node 'ip-10-0-136-112.ec2.internal' and this object" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" pod="openshift-must-gather-knccf/must-gather-s72bv" Sep 11 03:01:52.269717 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.269691 2557 scope.go:117] "RemoveContainer" containerID="1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676" Sep 11 03:01:52.269957 ip-10-0-136-112 kubenswrapper[2557]: E0911 03:01:52.269938 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676\": container with ID starting with 1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676 not found: ID does not exist" containerID="1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676" Sep 11 03:01:52.270015 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.269966 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676"} err="failed to get container status \"1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676\": rpc error: code = NotFound desc = could not find container \"1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676\": container with ID starting with 1be529735ed947ba5dc4ce9522100c1de5c9b216efcf1c7bdc87a917733eb676 not found: ID does not exist" Sep 11 03:01:52.270015 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.269983 2557 scope.go:117] "RemoveContainer" containerID="9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d" Sep 11 03:01:52.270216 ip-10-0-136-112 kubenswrapper[2557]: E0911 03:01:52.270203 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d\": container with ID starting with 9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d not found: ID does not exist" containerID="9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d" Sep 11 03:01:52.270253 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.270220 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d"} err="failed to get container status \"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d\": rpc error: code = NotFound desc = could not find container \"9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d\": container with ID starting with 9a021a93fc1cb9646ad90b6bfd322395d4cccad10dc05498d4f4934c9048533d not found: ID does not exist" Sep 11 03:01:52.840860 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.840829 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" path="/var/lib/kubelet/pods/eddc58ad-fec2-4f3c-914f-3283d444b61c/volumes" Sep 11 03:01:52.988169 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:52.988147 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/alertmanager/0.log" Sep 11 03:01:53.022990 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.022973 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/config-reloader/0.log" Sep 11 03:01:53.049896 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.049866 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/kube-rbac-proxy-web/0.log" Sep 11 03:01:53.077984 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.077966 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/kube-rbac-proxy/0.log" Sep 11 03:01:53.107336 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.107274 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/kube-rbac-proxy-metric/0.log" Sep 11 03:01:53.138312 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.138292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/prom-label-proxy/0.log" Sep 11 03:01:53.162994 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.162975 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d3a280a-c609-4d56-86c9-355ad2d57776/init-config-reloader/0.log" Sep 11 03:01:53.239245 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.239226 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-j6pjm_bd28ac26-942c-4e1f-b577-d96c6ba584f7/kube-state-metrics/0.log" Sep 11 03:01:53.261827 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.261807 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-j6pjm_bd28ac26-942c-4e1f-b577-d96c6ba584f7/kube-rbac-proxy-main/0.log" Sep 11 03:01:53.289253 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.289237 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-j6pjm_bd28ac26-942c-4e1f-b577-d96c6ba584f7/kube-rbac-proxy-self/0.log" Sep 11 03:01:53.321598 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.321567 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66898ddf98-qnzsz_d602ac9f-6796-4ed5-b507-3a48a001097b/metrics-server/0.log" Sep 11 03:01:53.360157 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.360100 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-zhjtl_8f764bb6-05b4-45d2-8db5-edb33e248783/monitoring-plugin/0.log" Sep 11 03:01:53.626369 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.626292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbq8_4153e8e0-a9e2-4776-8f42-2efbe90b19a4/node-exporter/0.log" Sep 11 03:01:53.651184 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.651154 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbq8_4153e8e0-a9e2-4776-8f42-2efbe90b19a4/kube-rbac-proxy/0.log" Sep 11 03:01:53.678753 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.678731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbq8_4153e8e0-a9e2-4776-8f42-2efbe90b19a4/init-textfile/0.log" Sep 11 03:01:53.814692 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.814677 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/prometheus/0.log" Sep 11 03:01:53.849477 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.849460 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/config-reloader/0.log" Sep 11 03:01:53.877510 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.877457 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/thanos-sidecar/0.log" Sep 11 03:01:53.899793 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.899776 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/kube-rbac-proxy-web/0.log" Sep 11 03:01:53.926361 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.926342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/kube-rbac-proxy/0.log" Sep 11 03:01:53.949018 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.949000 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/kube-rbac-proxy-thanos/0.log" Sep 11 03:01:53.975772 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:53.975748 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_494537dc-cd34-4f63-b346-6c930c9ef5fe/init-config-reloader/0.log" Sep 11 03:01:54.009823 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.009803 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wj82r_0c627a6a-9156-451b-a30f-198314adc348/prometheus-operator/0.log" Sep 11 03:01:54.030458 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.030441 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wj82r_0c627a6a-9156-451b-a30f-198314adc348/kube-rbac-proxy/0.log" Sep 11 03:01:54.073979 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.073957 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-fj5dt_57b82c9f-7915-4956-a0a3-63c7185f762c/prometheus-operator-admission-webhook/0.log" Sep 11 03:01:54.114997 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.114979 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f666f4955-xwxpp_205352a0-cc98-4fa1-be8a-d96fb77c85b7/telemeter-client/0.log" Sep 11 03:01:54.151824 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.151804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f666f4955-xwxpp_205352a0-cc98-4fa1-be8a-d96fb77c85b7/reload/0.log" Sep 11 03:01:54.173192 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.173164 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f666f4955-xwxpp_205352a0-cc98-4fa1-be8a-d96fb77c85b7/kube-rbac-proxy/0.log" Sep 11 03:01:54.231813 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.231794 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/thanos-query/0.log" Sep 11 03:01:54.259653 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.259630 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/kube-rbac-proxy-web/0.log" Sep 11 03:01:54.284610 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.284593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/kube-rbac-proxy/0.log" Sep 11 03:01:54.315114 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.315089 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/prom-label-proxy/0.log" Sep 11 03:01:54.343124 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.343097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/kube-rbac-proxy-rules/0.log" Sep 11 03:01:54.377229 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:54.377210 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5fc847-zqqv6_ae2cff2d-fad3-4849-aed0-d35aea621bdd/kube-rbac-proxy-metrics/0.log" Sep 11 03:01:56.842268 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:56.842235 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-khhcg_936c815e-4056-4baa-accf-3f0285f8d44e/download-server/0.log" Sep 11 03:01:58.165782 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.165749 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf"] Sep 11 03:01:58.166154 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166141 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="gather" Sep 11 03:01:58.166196 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166155 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="gather" Sep 11 03:01:58.166196 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166163 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="copy" Sep 11 03:01:58.166196 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166170 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="copy" Sep 11 03:01:58.166290 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166236 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="copy" Sep 11 03:01:58.166290 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.166245 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eddc58ad-fec2-4f3c-914f-3283d444b61c" containerName="gather" Sep 11 03:01:58.169182 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.169168 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.174475 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.174457 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtlfv\"/\"kube-root-ca.crt\"" Sep 11 03:01:58.174587 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.174471 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xtlfv\"/\"default-dockercfg-d8qd2\"" Sep 11 03:01:58.175036 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.175013 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtlfv\"/\"openshift-service-ca.crt\"" Sep 11 03:01:58.195517 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.195496 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf"] Sep 11 03:01:58.297773 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.297748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-podres\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.297911 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.297801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-proc\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.297911 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.297817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgh7\" (UniqueName: \"kubernetes.io/projected/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-kube-api-access-wjgh7\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.297911 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.297869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-lib-modules\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.297911 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.297887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-sys\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399009 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.398982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-podres\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399142 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-proc\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399142 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgh7\" (UniqueName: \"kubernetes.io/projected/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-kube-api-access-wjgh7\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399142 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-lib-modules\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399142 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399097 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-sys\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399142 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399115 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-proc\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399322 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399148 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-podres\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399322 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399163 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-sys\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.399322 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.399227 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-lib-modules\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.415579 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.415557 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgh7\" (UniqueName: \"kubernetes.io/projected/bc3ef5d2-7703-46a0-ab03-a4c03e4e0441-kube-api-access-wjgh7\") pod \"perf-node-gather-daemonset-fsqxf\" (UID: \"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441\") " pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.417039 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.416987 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c8djx_dce86686-f513-4061-9d2b-3e5c377471dc/dns/0.log" Sep 11 03:01:58.453516 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.453492 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c8djx_dce86686-f513-4061-9d2b-3e5c377471dc/kube-rbac-proxy/0.log" Sep 11 03:01:58.478987 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.478966 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:58.724691 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.724619 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j95rw_f6315050-4115-4755-9469-884121d46ebd/dns-node-resolver/0.log" Sep 11 03:01:58.755904 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:58.755883 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf"] Sep 11 03:01:58.758366 ip-10-0-136-112 kubenswrapper[2557]: W0911 03:01:58.758341 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc3ef5d2_7703_46a0_ab03_a4c03e4e0441.slice/crio-b30e88b3007bc86065c711dbb7bd62482b0d6dfc93ec7645f09c83837846b1db WatchSource:0}: Error finding container b30e88b3007bc86065c711dbb7bd62482b0d6dfc93ec7645f09c83837846b1db: Status 404 returned error can't find the container with id b30e88b3007bc86065c711dbb7bd62482b0d6dfc93ec7645f09c83837846b1db Sep 11 03:01:59.290586 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:59.290550 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" event={"ID":"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441","Type":"ContainerStarted","Data":"90f7006c8cdc9208761892e10d2dc5620bf848c3f20203d368a57092a70b3fed"} Sep 11 03:01:59.290928 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:59.290629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" event={"ID":"bc3ef5d2-7703-46a0-ab03-a4c03e4e0441","Type":"ContainerStarted","Data":"b30e88b3007bc86065c711dbb7bd62482b0d6dfc93ec7645f09c83837846b1db"} Sep 11 03:01:59.290928 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:59.290688 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:01:59.317813 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:59.317778 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" podStartSLOduration=1.317767034 podStartE2EDuration="1.317767034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:01:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:59.317742185 +0000 UTC m=+952.960076514" watchObservedRunningTime="2026-09-11 03:01:59.317767034 +0000 UTC m=+952.960101362" Sep 11 03:01:59.490220 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:01:59.490167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dlj9c_69eb83ca-8e97-4f03-9b08-1ac110899c25/node-ca/0.log" Sep 11 03:02:01.030682 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:01.030655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fzvl9_8f4dd375-455a-48c5-bc69-a96d8b5af794/serve-healthcheck-canary/0.log" Sep 11 03:02:01.639366 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:01.639336 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbhjf_20c553f6-5881-4db4-8bea-ab45c8ec25dd/kube-rbac-proxy/0.log" Sep 11 03:02:01.672390 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:01.672363 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbhjf_20c553f6-5881-4db4-8bea-ab45c8ec25dd/exporter/0.log" Sep 11 03:02:01.707797 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:01.707763 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbhjf_20c553f6-5881-4db4-8bea-ab45c8ec25dd/extractor/0.log" Sep 11 03:02:03.756738 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:03.756703 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-8v4vn_b262d108-ddfd-4167-8232-f26cce8fc28c/jobset-operator/0.log" Sep 11 03:02:05.305476 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:05.305449 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xtlfv/perf-node-gather-daemonset-fsqxf" Sep 11 03:02:08.496159 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.496128 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/kube-multus-additional-cni-plugins/0.log" Sep 11 03:02:08.516186 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.516155 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/egress-router-binary-copy/0.log" Sep 11 03:02:08.536325 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.536297 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/cni-plugins/0.log" Sep 11 03:02:08.557031 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.557002 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/bond-cni-plugin/0.log" Sep 11 03:02:08.577899 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.577875 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/routeoverride-cni/0.log" Sep 11 03:02:08.601147 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.601123 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/whereabouts-cni-bincopy/0.log" Sep 11 03:02:08.633117 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:08.633085 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24b84_af59951d-ddb6-4978-941a-000bc10b07ed/whereabouts-cni/0.log" Sep 11 03:02:09.108823 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.108788 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gdzkq_bbfda7b3-e2e7-4f82-a45d-beba8696a4dd/kube-multus/0.log" Sep 11 03:02:09.177191 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.177162 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wqxx6_30405c0e-1372-4d3c-9d73-6e09e0d31b36/network-metrics-daemon/0.log" Sep 11 03:02:09.194477 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.194448 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wqxx6_30405c0e-1372-4d3c-9d73-6e09e0d31b36/kube-rbac-proxy/0.log" Sep 11 03:02:09.928382 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.928347 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-controller/0.log" Sep 11 03:02:09.943884 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.943862 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/1.log" Sep 11 03:02:09.944020 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.943875 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovn-acl-logging/0.log" Sep 11 03:02:09.960694 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.960674 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/kube-rbac-proxy-node/0.log" Sep 11 03:02:09.979333 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.979316 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 03:02:09.998280 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:09.998254 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/northd/0.log" Sep 11 03:02:10.017608 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:10.017588 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/nbdb/0.log" Sep 11 03:02:10.036931 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:10.036915 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/sbdb/0.log" Sep 11 03:02:10.086752 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:10.086727 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mp5jm_8fb58ba3-6b9c-449d-9699-c49e0492f065/ovnkube-controller/0.log" Sep 11 03:02:11.475327 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:11.475293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-g8p6h_7d132393-a6d3-416a-a6c7-8c0184476e36/network-check-target-container/0.log" Sep 11 03:02:12.394362 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:12.394326 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cqx7h_5848ccb9-517b-4f12-95b1-02a4d871129f/iptables-alerter/0.log" Sep 11 03:02:13.058578 ip-10-0-136-112 kubenswrapper[2557]: I0911 03:02:13.058551 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-s2sfr_08342c09-b4ce-4829-a634-880bce6c329f/tuned/0.log"